-- Logs begin at Thu 2022-06-23 10:03:28 UTC, end at Thu 2022-06-23 11:17:55 UTC. -- Jun 23 10:35:34.363636 dv-cinder-846146-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 10:35:34.373059 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 10:35:34 2022] *** Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: nodename: dv-cinder-846146-4-iscsi Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: machine: x86_64 Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: clock source: unix Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: pcre jit disabled Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: detected number of CPU cores: 4 Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: current working directory: / Jun 23 10:35:34.375102 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: detected binary path: /usr/bin/uwsgi-core Jun 23 10:35:34.375736 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: your processes number limit is 47680 Jun 23 10:35:34.375736 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: your memory page size is 4096 bytes Jun 23 10:35:34.375736 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: detected max file descriptor number: 2048 Jun 23 10:35:34.375736 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: lock engine: pthread robust mutexes Jun 23 10:35:34.375736 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: thunder lock: enabled Jun 23 10:35:34.375736 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 10:35:34.375736 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 10:35:34.424097 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: Python main interpreter initialized at 0x559dfb7c29c0 Jun 23 10:35:34.424097 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: python threads support enabled Jun 23 10:35:34.424097 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: your server socket listen backlog is limited to 100 connections Jun 23 10:35:34.424097 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: your mercy for graceful operations on workers is 90 seconds Jun 23 10:35:34.424459 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 10:35:34.424547 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: *** Operational MODE: preforking *** Jun 23 10:35:34.424845 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: *** uWSGI is running in multiple interpreter mode *** Jun 23 10:35:34.424845 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: spawned uWSGI master process (pid: 91919) Jun 23 10:35:34.425059 dv-cinder-846146-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 23 10:35:34.425869 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: spawned uWSGI worker 1 (pid: 91930, cores: 1) Jun 23 10:35:34.425958 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: spawned uWSGI worker 2 (pid: 91931, cores: 1) Jun 23 10:35:34.428738 dv-cinder-846146-4-iscsi devstack@keystone.service[91919]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 10:35:39.970211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:35:39.970211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: from cryptography.utils import int_from_bytes Jun 23 10:35:39.971048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:35:39.971048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: from cryptography.utils import int_from_bytes Jun 23 10:35:39.971894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:35:39.971894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: from cryptography.utils import int_from_bytes Jun 23 10:35:39.972348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:35:39.972348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: from cryptography.utils import int_from_bytes Jun 23 10:35:40.019184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:35:40.019388 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:35:40.019584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] command line args: [] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:35:40.019855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:35:40.020034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ================================================================================ {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:35:40.020287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] admin_token = **** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.020536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] config_dir = [] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.020728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.020911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] config_source = [] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.021089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] debug = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.021167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:35:40.021288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.021556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:35:40.021556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] command line args: [] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:35:40.021948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.022130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.022407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.022677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.022796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:35:40.022904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] list_limit = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.023017 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ================================================================================ {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:35:40.023096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] log_config_append = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.023228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] admin_token = **** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.023309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.023420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] log_dir = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.023497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] config_dir = [] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.023614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] log_file = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.023704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.023821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] config_source = [] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.023903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] debug = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024317 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024701 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.024943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.025092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.025183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.025345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.025525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] list_limit = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.026084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] log_config_append = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.026161 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.026232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.026427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] log_dir = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.026522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.026609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] log_file = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.026795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.026918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.027032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.027165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.027274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.027379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.027519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.027631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.027738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.027868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.027978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.028144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.028261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.028368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.028499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] publish_errors = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.028614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.028725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.028857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.028963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.029067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.029169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.029279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.029387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.029469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.029538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.029664 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] standard_threads = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.029742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.029897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.030012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.030143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.030336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.030522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] use_journal = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.030607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.030716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] use_json = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.030797 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] publish_errors = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.030867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] use_stderr = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.030990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.031063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] use_syslog = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.031138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.031242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.031324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.031499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.031582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.031737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.031813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.031996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.032102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] standard_threads = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.032236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.032318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.032480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.032556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.032659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.032733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.032841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] use_journal = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.032956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.033033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] use_json = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.033186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] use_stderr = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.033261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.033366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] use_syslog = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.033453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.033602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:35:40.033678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.033865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.033946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.034110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.034194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.034381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.034470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.034622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.034733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.034869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.034955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.035110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.035192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.035342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.035424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.035594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.035676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.035842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.035918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.036089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.036170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.036326 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.036469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.036565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.036641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.036817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.036898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.037060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.037144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.037304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.037381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.037535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.037616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.037764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.037859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.037993 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.038069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.038228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.038304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.038498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.038584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.038745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.038827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.038975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.039051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.039203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.039291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.039447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.039528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.039692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.039768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.039929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.040006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.040175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.040251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.040413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.040488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.040649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.040727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.040886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.040961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.041222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.041405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.041489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.041567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.041702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.041773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.041841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.041908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.042046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.042119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.042271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.042367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.042530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.042618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.042766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.042849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.043001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.043082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.043237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.043318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.043472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.043555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.043706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.043774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.043941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.044012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.044175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.044242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.044408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.044474 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.044645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.044710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.044877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.044986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.045093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.045198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.045330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.045504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.045622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.045731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.045868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.045974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.046080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.046213 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.046358 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.046476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.046476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.046715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.046822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.046928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.046928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.047175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.047289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.047431 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.047543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.047682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.047682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.047890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.047890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.048088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.048228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.048334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.048440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.048582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.048688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.048794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.048937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049161 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.049966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.050110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.050187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.050366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.050460 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.050606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.050695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.050840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.050917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.051075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.051160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.051334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.051411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.051573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.051649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.051812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.051896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.052043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.052120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.052282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.052358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.052518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.052601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.052747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.052824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.052986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.053062 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.053212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.053361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.053435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.053506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.053656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.053733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.053897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.053981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.054127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.054219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.054387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.054467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.054627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.054720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.054864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.054949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.055099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.055175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.055335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.055413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.055568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.055653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.055801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.055879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.056034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.056111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] auth.external = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.056262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.056345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.056492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.056568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.056737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.056817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.056977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.057065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] auth.password = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.057228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.057305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] auth.token = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.057467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.057543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.057725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.057830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.057978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.058068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.058211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.058293 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.058476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] auth.external = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.058563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.058710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.058795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.058939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.059015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.059176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] credential.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.059252 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.059420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.059499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] auth.password = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.059666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.059779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] auth.token = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.059905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.059990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.060137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.060221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.060379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.060461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.060610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.060685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.060859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.060938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.061105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.061182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.061338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.061415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.061574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] credential.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.061652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.061822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.061905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.062072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.062150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.062372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.062456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.062580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.062657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.062826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.062902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.063059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] federation.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.063137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.063294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.063379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.063537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.063616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.063781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.063860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.064261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.064343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.064508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.064586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.064745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.064824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.064997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.065074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.065239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.065318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.065493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.065572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.065729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] federation.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.065805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.065969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.066046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.066201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.066279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.066469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.066547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.066701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.066776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.066936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.067015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.067175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.067252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.067420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.067496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.067638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.067713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.067875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.067953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.068123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.068208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.068371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.068450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.068602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.068679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.068831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.068916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.069061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.069139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.069304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.069382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.069540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.069624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.069784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.069862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.070015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.070091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.070255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.070359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.070532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.070610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.070772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.070849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.071006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.071091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.071262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.071348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.071463 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.071540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.071690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.071778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.071925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.072003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.072164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.072242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.072999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.073102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.073168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.073292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.073525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.073601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.073771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.073856 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.074018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.074096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.074254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.074350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.074536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.074623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.074757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.074835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.074987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.075064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.075222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.075307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.075452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.075529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.075687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.075763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.075921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.076006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.076160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.076238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.076395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.076473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.076632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.076959 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.076959 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.077119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.077191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.077261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.077331 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.077407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.077538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.077616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.077769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.077845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.078014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.078099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.078247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.078380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.078508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.078596 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.078745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.078830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.078972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.079048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.079213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.079291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.079459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.079543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.079696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.079783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.079928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.080006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.080170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.080256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.080415 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.080493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.080652 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.080727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.080878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.080956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.081113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.081191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.081347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.081424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.081582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.081661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.081811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.081888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.082054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.082131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.082298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.082395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.082563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.082641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.082811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.082888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.083050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.083130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.083277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.083354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.083514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.083590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.083748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.083826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.083983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.084059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.084216 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.084292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.084450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.084529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.084694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.084772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.084939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.085016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.085176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.085255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.085421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.085496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.085647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.085724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.085893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.085971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.086126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.086203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.086382 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.086464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.086627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.086707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.086862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.086938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.087100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.087176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.087330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.087409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.087565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.087652 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.087803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] resource.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.087907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.088605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.088855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.088940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.089091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.089169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.089339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.089425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.089580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.089657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.089813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.089889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.090056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.090141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.090291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.090414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.090551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.090628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.090786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] role.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.090875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.091030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] role.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.091107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] resource.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.091257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.091335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.091505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.091656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.091751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.091830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.091997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.092075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.092241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.092328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.092481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.092558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.092722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.092799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.092957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.093042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.093199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.093277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.093429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.093505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] role.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.093673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.093758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] role.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.093904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.093980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.094150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.094227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.094420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.094504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.094683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.094815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.094935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.095052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.095186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.095300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.095434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.095546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.095683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.095792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.095934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.096041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.096170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.096274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.096420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.096525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.096670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.096776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.096919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.097015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.097168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.097246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.097465 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.097564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.097696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.097803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.097946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.098056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.098199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.098328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.098478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.098584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.098715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.098839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.098943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.099079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.099167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.099330 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.099408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] token.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.099583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.099662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.099823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.099904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.100058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.100134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.100292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.100371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.100527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.100605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.100760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.100839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.101002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.101081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.101245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.101330 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.101485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.101562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.101717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.101795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.101946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.102022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.102178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.102254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] token.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.102445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.102527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.102692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.102769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.102926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.103003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.103167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.103247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.103440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.103596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.103734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.103823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.connection = **** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.103964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.104083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.104209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.104373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.104452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.104615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.104712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.104858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.104944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.105095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.105173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.105329 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.105406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.105562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.105648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.105798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.105876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.106043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.106120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.106284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.106415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.106551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.106680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.connection = **** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.106786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.106927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.107031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.107177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.107263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.107419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.107497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.107665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.107743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.107904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.107990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.108146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.108224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.108333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:35:40.108412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.108609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.108864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.109104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.109356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.109596 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.109845 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.110081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.110373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.110582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.110825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.111065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:35:40.111240 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:35:40.138735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.138962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.139184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.141193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.141431 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.141656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.147602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.150158 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.175511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.175741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.176745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.176981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.322145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.322378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.371411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.371642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.372284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.372523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.435600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.435776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.435850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.435950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.436032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.436109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.436237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.436322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.436452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.436589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.436675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.436813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.461911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.462140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.462391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.462509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.462620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.462745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.462825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.463538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.463764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.463854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.463984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.464070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.464197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.464411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.475491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.475681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.488861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.488977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.489094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.489177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.489316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.489398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.489536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.489625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.489748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.489828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.489958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.490037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.490170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.490258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:35:40.507930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.508105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.508189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:35:40.508314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:35:40.508461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.508647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.508728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:35:40.508847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:35:40.508928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.509117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.509207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.509379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.509458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.509635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.509714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.509972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.521221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.521221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.521395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.521478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.521554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.521643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.521722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.521722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.530373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.530681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.533638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.533914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.533995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.534519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.534608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.534686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.534751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.534814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.534875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.535006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.535086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.535273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.535346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.535543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.535614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.535814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.535893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.536080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.536149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.536338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.536406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.536602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.563536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.563696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.565401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.565569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.565682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.565851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.570946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.571162 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.571339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.571556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.571638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.571839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.579529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.579700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.579795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.579983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.584206 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.584488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.584569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.584765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.584847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.585040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.585131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.585315 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.585396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.585588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.585669 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.585852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.585930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.586114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.586201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.586406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.605524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.605794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.606094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.606398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.610468 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.611103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.614059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.614479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.614764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.615162 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.619615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.620410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.623222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.624050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.626892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.627189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.627466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.627743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.627824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.628021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.628104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.628296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.628378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.628579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.628861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.629139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.647990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.648270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.648534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.648729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.648811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.649012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.649274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.649541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.657300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.658029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.659013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.659298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.659768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.660053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.662479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.662762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.663045 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.663300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.663381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.663580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.663663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.663859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.664139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.664430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.676848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.677118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.677404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.677681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.677964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.678243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.678623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.678906 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.679355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.679647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.679956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.680524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.680818 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.681119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.698625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.700038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.701967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.703341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.705277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.706678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.707016 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.708417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.708635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.708912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.709188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.710050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.710338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.717145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.718661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.718747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.720272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.721956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.722249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.722661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.722937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.723530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.723827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.724219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.724500 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.732343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.732627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.732910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.733725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.734013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.734303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.740752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.741028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.741303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.741575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.741841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.742200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:35:40.742282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.742516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.742599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.742785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.742866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.743066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.743153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.743340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.743420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.743608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.743741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.743872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.743993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.744135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.744332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.744549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.744644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.744944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.745158 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.745420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.745692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.745954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:35:40.783361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559dfb7c29c0 pid: 91931 (default app) Jun 23 10:35:40.786751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fa03b-7b46-46de-b9ce-1b8ff88dea4a None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:40.787044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fa03b-7b46-46de-b9ce-1b8ff88dea4a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:40.787322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fa03b-7b46-46de-b9ce-1b8ff88dea4a None None] PATH_INFO: `/v3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:40.788153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559dfb7c29c0 pid: 91930 (default app) Jun 23 10:35:40.791571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Thu Jun 23 10:35:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:35:48.631456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e817c6-7cb5-429b-b69a-e386160dbf98 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:48.632029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e817c6-7cb5-429b-b69a-e386160dbf98 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:48.632029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e817c6-7cb5-429b-b69a-e386160dbf98 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:48.637082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:35:48.643088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:48.643543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:48.643657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:48.713562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: INFO dbcounter [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] Registered counter for database keystone Jun 23 10:35:48.734940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG oslo_db.sqlalchemy.engines [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:35:48.741333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writer thread running {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:35:48.921184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG passlib.handlers.bcrypt [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91931) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 10:35:48.921593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG passlib.handlers.bcrypt [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91931) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 10:35:48.978365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:48.980020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:49.107262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 10:35:49.270163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e817c6-7cb5-429b-b69a-e386160dbf98 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:49.341166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: INFO dbcounter [None req-49e817c6-7cb5-429b-b69a-e386160dbf98 None None] Registered counter for database keystone Jun 23 10:35:49.360376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG oslo_db.sqlalchemy.engines [None req-49e817c6-7cb5-429b-b69a-e386160dbf98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91930) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:35:49.366721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writer thread running {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:35:49.487878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e817c6-7cb5-429b-b69a-e386160dbf98 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:49.492189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3f10b-87e0-4eae-a2b7-49701a0cfd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:49.492851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3f10b-87e0-4eae-a2b7-49701a0cfd0b admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:49.493141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3f10b-87e0-4eae-a2b7-49701a0cfd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:49.493426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3f10b-87e0-4eae-a2b7-49701a0cfd0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:49.502543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3f10b-87e0-4eae-a2b7-49701a0cfd0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:49.554670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a1c3f10b-87e0-4eae-a2b7-49701a0cfd0b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 10:35:49.555028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3f10b-87e0-4eae-a2b7-49701a0cfd0b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:49.565845 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jun 23 10:35:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 10:35:49.572696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:49.588563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a7a6d-03cb-4d5c-be85-2b123b702eb8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:49.593259 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2c070-ce6d-461b-9bd0-6213ff684226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:49.594583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2c070-ce6d-461b-9bd0-6213ff684226 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:49.594762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2c070-ce6d-461b-9bd0-6213ff684226 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:49.595000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2c070-ce6d-461b-9bd0-6213ff684226 admin admin] PATH_INFO: `/v3/projects/90bfbe3ca19640a8a67be01b638e500f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:49.599184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2c070-ce6d-461b-9bd0-6213ff684226 admin admin] RBAC: Authorizing `identity:get_project(project_id=90bfbe3ca19640a8a67be01b638e500f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:49.654333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WARNING keystone.common.rbac_enforcer.enforcer [None req-86b2c070-ce6d-461b-9bd0-6213ff684226 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 10:35:49.654957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2c070-ce6d-461b-9bd0-6213ff684226 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:49.659390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Thu Jun 23 10:35:49 2022] GET /identity/v3/projects/90bfbe3ca19640a8a67be01b638e500f => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:35:51.709132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515da54-6e59-4524-93f9-30a1b0b80a60 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:51.709688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515da54-6e59-4524-93f9-30a1b0b80a60 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:51.709688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515da54-6e59-4524-93f9-30a1b0b80a60 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:51.714450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:35:51.719797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac1907-567d-4305-ba3b-90b8d9aee94b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:51.720205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac1907-567d-4305-ba3b-90b8d9aee94b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:51.720394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac1907-567d-4305-ba3b-90b8d9aee94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:51.740364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-1eac1907-567d-4305-ba3b-90b8d9aee94b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:51.741915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1eac1907-567d-4305-ba3b-90b8d9aee94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:51.750627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 10:35:51.779885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515da54-6e59-4524-93f9-30a1b0b80a60 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:51.792219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515da54-6e59-4524-93f9-30a1b0b80a60 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:51.796353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07393a4f-8385-48ef-8bbd-08ab8266d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:51.797000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07393a4f-8385-48ef-8bbd-08ab8266d247 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:51.797282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07393a4f-8385-48ef-8bbd-08ab8266d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:51.797559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07393a4f-8385-48ef-8bbd-08ab8266d247 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:51.810057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07393a4f-8385-48ef-8bbd-08ab8266d247 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:51.811907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07393a4f-8385-48ef-8bbd-08ab8266d247 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:51.821475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jun 23 10:35:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:35:51.827999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac1907-567d-4305-ba3b-90b8d9aee94b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:51.840019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac1907-567d-4305-ba3b-90b8d9aee94b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:51.844477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51908c-077a-4c5f-8109-2b137542f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:51.845362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51908c-077a-4c5f-8109-2b137542f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:51.845653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51908c-077a-4c5f-8109-2b137542f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:51.845937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51908c-077a-4c5f-8109-2b137542f9e3 admin admin] PATH_INFO: `/v3/users/a27ae7f7dcd846e6909f95c2447d5f53` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:51.847386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51908c-077a-4c5f-8109-2b137542f9e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=a27ae7f7dcd846e6909f95c2447d5f53)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:51.849228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51908c-077a-4c5f-8109-2b137542f9e3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:51.850888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Thu Jun 23 10:35:51 2022] GET /identity/v3/users/a27ae7f7dcd846e6909f95c2447d5f53 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:35:53.987709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea90d48-4a7f-4384-b727-abdb2c69e750 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:53.988226 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea90d48-4a7f-4384-b727-abdb2c69e750 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:53.988307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea90d48-4a7f-4384-b727-abdb2c69e750 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:53.989659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:35:53.995349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb21f3-1cd4-4f13-b580-755b38d46310 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:53.995814 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3df2d6-a9bf-42fa-bce4-a93047c0327d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:53.995888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb21f3-1cd4-4f13-b580-755b38d46310 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:53.995984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3df2d6-a9bf-42fa-bce4-a93047c0327d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:53.996064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb21f3-1cd4-4f13-b580-755b38d46310 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:53.996156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3df2d6-a9bf-42fa-bce4-a93047c0327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:53.997294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:35:54.002909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0db419-9ede-4b16-a794-417bca156be8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:54.003203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0db419-9ede-4b16-a794-417bca156be8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:54.003498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0db419-9ede-4b16-a794-417bca156be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:54.026551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0a0db419-9ede-4b16-a794-417bca156be8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:54.027769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0a0db419-9ede-4b16-a794-417bca156be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:54.036267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG passlib.handlers.bcrypt [None req-2a3df2d6-a9bf-42fa-bce4-a93047c0327d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91930) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 10:35:54.036699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG passlib.handlers.bcrypt [None req-2a3df2d6-a9bf-42fa-bce4-a93047c0327d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91930) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 10:35:54.083894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2a3df2d6-a9bf-42fa-bce4-a93047c0327d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:54.085495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2a3df2d6-a9bf-42fa-bce4-a93047c0327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:54.122673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 7/12] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:35:54.155566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0db419-9ede-4b16-a794-417bca156be8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:54.174525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:54.194719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 6/13] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:35:54.219635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3df2d6-a9bf-42fa-bce4-a93047c0327d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:54.257559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0db419-9ede-4b16-a794-417bca156be8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:54.297888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ef071-9a7d-4f5c-853a-5dc5109eb650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:54.299007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef071-9a7d-4f5c-853a-5dc5109eb650 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:54.299505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef071-9a7d-4f5c-853a-5dc5109eb650 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:54.300010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ef071-9a7d-4f5c-853a-5dc5109eb650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:54.330668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3df2d6-a9bf-42fa-bce4-a93047c0327d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:54.333067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:54.374376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43770c7-24d8-4ddf-905a-3c3056c0bf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:54.375568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43770c7-24d8-4ddf-905a-3c3056c0bf25 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:54.375860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43770c7-24d8-4ddf-905a-3c3056c0bf25 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:54.376144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43770c7-24d8-4ddf-905a-3c3056c0bf25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:54.377358 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ef071-9a7d-4f5c-853a-5dc5109eb650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:54.378897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ef071-9a7d-4f5c-853a-5dc5109eb650 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:54.388600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43770c7-24d8-4ddf-905a-3c3056c0bf25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-d43770c7-24d8-4ddf-905a-3c3056c0bf25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:35:54.400025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:35:54.401600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:35:54.402507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:35:54.404274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:54.410576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43770c7-24d8-4ddf-905a-3c3056c0bf25 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:54.487321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 8/15] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:35:54.493282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ef071-9a7d-4f5c-853a-5dc5109eb650 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:54.517250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43770c7-24d8-4ddf-905a-3c3056c0bf25 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:54.555785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af934735-5056-45ac-8176-ca067393b2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:54.558061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af934735-5056-45ac-8176-ca067393b2d4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:54.558374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af934735-5056-45ac-8176-ca067393b2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:54.558664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af934735-5056-45ac-8176-ca067393b2d4 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:54.559439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af934735-5056-45ac-8176-ca067393b2d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:35:54.559749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af934735-5056-45ac-8176-ca067393b2d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:54.561212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af934735-5056-45ac-8176-ca067393b2d4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:54.574035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 8/16] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:35:54.579592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af934735-5056-45ac-8176-ca067393b2d4 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:54.608141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:54.621108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ef071-9a7d-4f5c-853a-5dc5109eb650 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:54.646256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:54.665296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc7d70-4dde-4462-82ee-e637eb7c32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:54.667302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc7d70-4dde-4462-82ee-e637eb7c32d9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:54.667585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc7d70-4dde-4462-82ee-e637eb7c32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:54.667869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc7d70-4dde-4462-82ee-e637eb7c32d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:54.679040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc7d70-4dde-4462-82ee-e637eb7c32d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:54.680552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc7d70-4dde-4462-82ee-e637eb7c32d9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:54.683975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af934735-5056-45ac-8176-ca067393b2d4 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-14fc7d70-4dde-4462-82ee-e637eb7c32d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:35:54.704304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:35:54.706359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:35:54.707920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:35:54.707920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:35:54.707920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:35:54.707920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:35:54.707920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:35:54.711453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc7d70-4dde-4462-82ee-e637eb7c32d9 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:54.720800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837253f-e793-4ba4-9c50-5c4e2fd82ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:54.721677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837253f-e793-4ba4-9c50-5c4e2fd82ea0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:54.721958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837253f-e793-4ba4-9c50-5c4e2fd82ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:54.722238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837253f-e793-4ba4-9c50-5c4e2fd82ea0 None admin] PATH_INFO: `/v3/users/a27ae7f7dcd846e6909f95c2447d5f53` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:54.723860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837253f-e793-4ba4-9c50-5c4e2fd82ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=a27ae7f7dcd846e6909f95c2447d5f53)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:54.725336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837253f-e793-4ba4-9c50-5c4e2fd82ea0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:54.727037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:35:54 2022] GET /identity/v3/users/a27ae7f7dcd846e6909f95c2447d5f53 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:35:54.734751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837253f-e793-4ba4-9c50-5c4e2fd82ea0 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:54.828036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc7d70-4dde-4462-82ee-e637eb7c32d9 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:54.857930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:54.864781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324615f-d98e-4d1b-b587-53b6d03ded90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:54.865441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324615f-d98e-4d1b-b587-53b6d03ded90 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:54.865726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324615f-d98e-4d1b-b587-53b6d03ded90 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:54.866005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324615f-d98e-4d1b-b587-53b6d03ded90 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:54.866772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324615f-d98e-4d1b-b587-53b6d03ded90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:35:54.867079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324615f-d98e-4d1b-b587-53b6d03ded90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:54.868488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324615f-d98e-4d1b-b587-53b6d03ded90 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:54.870882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837253f-e793-4ba4-9c50-5c4e2fd82ea0 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:54.887722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:35:54.914076 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e482a71-b952-4e8d-9c65-1af575b3e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:54.914930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e482a71-b952-4e8d-9c65-1af575b3e187 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:54.915221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e482a71-b952-4e8d-9c65-1af575b3e187 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:54.915504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e482a71-b952-4e8d-9c65-1af575b3e187 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:54.916981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e482a71-b952-4e8d-9c65-1af575b3e187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:54.918659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e482a71-b952-4e8d-9c65-1af575b3e187 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:54.920451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:35:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:35:54.928429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324615f-d98e-4d1b-b587-53b6d03ded90 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:54.972230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:55.048884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324615f-d98e-4d1b-b587-53b6d03ded90 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:55.084314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6860b-c911-40b1-a3de-cdf9486075f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:55.084911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6860b-c911-40b1-a3de-cdf9486075f0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:55.085200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6860b-c911-40b1-a3de-cdf9486075f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:55.085484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6860b-c911-40b1-a3de-cdf9486075f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:55.086419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6860b-c911-40b1-a3de-cdf9486075f0 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.domain.id=default, user.id=a27ae7f7dcd846e6909f95c2447d5f53) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:35:55.086749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6860b-c911-40b1-a3de-cdf9486075f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:55.089045 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6860b-c911-40b1-a3de-cdf9486075f0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:55.096751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jun 23 10:35:54 2022] GET /identity/v3/role_assignments?user.id=a27ae7f7dcd846e6909f95c2447d5f53&scope.domain.id=default&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 233 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:35:57.606820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bdacc-7eba-4485-9e9f-54f37aa5b5f8 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:57.607919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bdacc-7eba-4485-9e9f-54f37aa5b5f8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:57.608407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bdacc-7eba-4485-9e9f-54f37aa5b5f8 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:57.610083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:35:57.616126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2df31-33e7-4e08-b846-9edd95895db9 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:57.617126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2df31-33e7-4e08-b846-9edd95895db9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:57.617649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2df31-33e7-4e08-b846-9edd95895db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:57.640257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-79b2df31-33e7-4e08-b846-9edd95895db9 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:57.642120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-79b2df31-33e7-4e08-b846-9edd95895db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:57.745673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:35:57.787879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bdacc-7eba-4485-9e9f-54f37aa5b5f8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:57.854503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0f29-18ff-470a-9924-01c9b7e91711 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:57.855169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0f29-18ff-470a-9924-01c9b7e91711 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:57.855655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c0f29-18ff-470a-9924-01c9b7e91711 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:57.857273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:35:57.862512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db4c3-6f8d-45ad-b98f-138043911997 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:57.863054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db4c3-6f8d-45ad-b98f-138043911997 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:57.863558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db4c3-6f8d-45ad-b98f-138043911997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:57.901500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f31db4c3-6f8d-45ad-b98f-138043911997 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:57.904183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f31db4c3-6f8d-45ad-b98f-138043911997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:57.959469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:57.975846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bdacc-7eba-4485-9e9f-54f37aa5b5f8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:58.023063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a9eb3-876e-4131-91b7-4b9c1f27a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:58.023737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a9eb3-876e-4131-91b7-4b9c1f27a223 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.024023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a9eb3-876e-4131-91b7-4b9c1f27a223 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.024304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a9eb3-876e-4131-91b7-4b9c1f27a223 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.025778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a9eb3-876e-4131-91b7-4b9c1f27a223 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:58.027539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a9eb3-876e-4131-91b7-4b9c1f27a223 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:58.029090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 14/25] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:35:58.032032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a8e9d-c78a-4022-8ead-9b551f7d6d67 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.032485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a8e9d-c78a-4022-8ead-9b551f7d6d67 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.032902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a8e9d-c78a-4022-8ead-9b551f7d6d67 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.035320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 15/26] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:35:58.036878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81568f2b-4e29-469e-806c-2bd85d6be0e9 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.037335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81568f2b-4e29-469e-806c-2bd85d6be0e9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.037944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81568f2b-4e29-469e-806c-2bd85d6be0e9 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.043721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 16/27] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:35:58.045471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e67ee-fe77-4ed1-a68b-379993c00c4e None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.045908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e67ee-fe77-4ed1-a68b-379993c00c4e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.046772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e67ee-fe77-4ed1-a68b-379993c00c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.076300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-626e67ee-fe77-4ed1-a68b-379993c00c4e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:58.077721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-626e67ee-fe77-4ed1-a68b-379993c00c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:58.153445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 17/28] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:35:58.155067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349035e8-d882-497f-9cb2-feca60bedd47 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.155498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349035e8-d882-497f-9cb2-feca60bedd47 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.155944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349035e8-d882-497f-9cb2-feca60bedd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.186766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-349035e8-d882-497f-9cb2-feca60bedd47 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:58.187919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 12/29] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 23 10:35:57 2022] POST /identity/v3/roles => generated 219 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:35:58.188654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-349035e8-d882-497f-9cb2-feca60bedd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:58.190218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a9eb3-876e-4131-91b7-4b9c1f27a223 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:58.225635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:58.303834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 18/30] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:35:58.304934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349035e8-d882-497f-9cb2-feca60bedd47 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:58.317684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a9eb3-876e-4131-91b7-4b9c1f27a223 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:58.337098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:58.363387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317162d-ea2b-46bc-85eb-403958bf1e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:58.364264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317162d-ea2b-46bc-85eb-403958bf1e88 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.364559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317162d-ea2b-46bc-85eb-403958bf1e88 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.364853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317162d-ea2b-46bc-85eb-403958bf1e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.409840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317162d-ea2b-46bc-85eb-403958bf1e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:58.411717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317162d-ea2b-46bc-85eb-403958bf1e88 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-7317162d-ea2b-46bc-85eb-403958bf1e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:35:58.445712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:35:58.446807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:35:58.447840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:35:58.447840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:35:58.447840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:35:58.447840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:35:58.447840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 13/31] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:35:58.447840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317162d-ea2b-46bc-85eb-403958bf1e88 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:58.461003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349035e8-d882-497f-9cb2-feca60bedd47 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:58.508898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475ada-733e-4562-a9b0-2f0371b490d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:58.510068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475ada-733e-4562-a9b0-2f0371b490d0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.510555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475ada-733e-4562-a9b0-2f0371b490d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.511008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475ada-733e-4562-a9b0-2f0371b490d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.543667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38475ada-733e-4562-a9b0-2f0371b490d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:35:58.550360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-38475ada-733e-4562-a9b0-2f0371b490d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:35:58.554683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:35:58.555732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:35:58.557249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:35:58.566004 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 19/32] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:35:58.567595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475ada-733e-4562-a9b0-2f0371b490d0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:58.584167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317162d-ea2b-46bc-85eb-403958bf1e88 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:58.636399 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400f6b2-a2bc-482f-b69b-bc90562147fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:58.637155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f6b2-a2bc-482f-b69b-bc90562147fa None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.637435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f6b2-a2bc-482f-b69b-bc90562147fa None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.637720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f6b2-a2bc-482f-b69b-bc90562147fa None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.638536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400f6b2-a2bc-482f-b69b-bc90562147fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:58.640275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400f6b2-a2bc-482f-b69b-bc90562147fa None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:58.660036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 14/33] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 23 10:35:58 2022] POST /identity/v3/roles => generated 225 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:35:58.661714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400f6b2-a2bc-482f-b69b-bc90562147fa None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:58.691719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:58.749517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475ada-733e-4562-a9b0-2f0371b490d0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:58.814412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5b369-edbf-4b6c-848d-c036dafc019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:58.815100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b369-edbf-4b6c-848d-c036dafc019f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.815391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b369-edbf-4b6c-848d-c036dafc019f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.815674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5b369-edbf-4b6c-848d-c036dafc019f None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.816494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b369-edbf-4b6c-848d-c036dafc019f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:35:58.816924 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b369-edbf-4b6c-848d-c036dafc019f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:58.818478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5b369-edbf-4b6c-848d-c036dafc019f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:58.833780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400f6b2-a2bc-482f-b69b-bc90562147fa None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:58.835971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 20/34] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:35:58.839571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194895d7-e79a-48b1-a4ee-005f7405656d None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.839877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194895d7-e79a-48b1-a4ee-005f7405656d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.840114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194895d7-e79a-48b1-a4ee-005f7405656d None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.841978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 21/35] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:35:58.849982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb681a-c928-439a-b04a-f393c0eac737 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.850270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb681a-c928-439a-b04a-f393c0eac737 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.850587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb681a-c928-439a-b04a-f393c0eac737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.873567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-5adb681a-c928-439a-b04a-f393c0eac737 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:58.875094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5adb681a-c928-439a-b04a-f393c0eac737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:58.897825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add6340-7733-48b1-9eb3-608fc1f32bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:58.898710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add6340-7733-48b1-9eb3-608fc1f32bb0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:58.899020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add6340-7733-48b1-9eb3-608fc1f32bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:58.899495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add6340-7733-48b1-9eb3-608fc1f32bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:58.901000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add6340-7733-48b1-9eb3-608fc1f32bb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:35:58.901375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add6340-7733-48b1-9eb3-608fc1f32bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:58.903268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add6340-7733-48b1-9eb3-608fc1f32bb0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:58.904617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:58.917477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 15/36] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:35:58.918879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add6340-7733-48b1-9eb3-608fc1f32bb0 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:58.972927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 22/37] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:35:58.973867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb681a-c928-439a-b04a-f393c0eac737 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:59.059535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add6340-7733-48b1-9eb3-608fc1f32bb0 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:59.060834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:59.099445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54381c-dfb2-4a37-a661-b7d85315e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:59.100116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54381c-dfb2-4a37-a661-b7d85315e5f2 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:59.100406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54381c-dfb2-4a37-a661-b7d85315e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:59.100695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54381c-dfb2-4a37-a661-b7d85315e5f2 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:59.101075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb681a-c928-439a-b04a-f393c0eac737 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:59.101422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54381c-dfb2-4a37-a661-b7d85315e5f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:59.102949 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54381c-dfb2-4a37-a661-b7d85315e5f2 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:59.142355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 16/38] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:35:58 2022] POST /identity/v3/projects => generated 301 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:35:59.142355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54381c-dfb2-4a37-a661-b7d85315e5f2 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:59.151275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcad4b-86e1-4488-9bc8-2ff0696f23f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:59.152404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcad4b-86e1-4488-9bc8-2ff0696f23f2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:59.152695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcad4b-86e1-4488-9bc8-2ff0696f23f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:59.152972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcad4b-86e1-4488-9bc8-2ff0696f23f2 None admin] PATH_INFO: `/v3/users/a27ae7f7dcd846e6909f95c2447d5f53` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:59.154282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcad4b-86e1-4488-9bc8-2ff0696f23f2 None admin] RBAC: Authorizing `identity:get_user(user_id=a27ae7f7dcd846e6909f95c2447d5f53)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:59.156002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcad4b-86e1-4488-9bc8-2ff0696f23f2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:59.158158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 23/39] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:35:58 2022] GET /identity/v3/users/a27ae7f7dcd846e6909f95c2447d5f53 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:35:59.163832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcad4b-86e1-4488-9bc8-2ff0696f23f2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:59.214698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:59.292951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54381c-dfb2-4a37-a661-b7d85315e5f2 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:59.335224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcad4b-86e1-4488-9bc8-2ff0696f23f2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:59.345625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72fbcd-a1d5-42e8-ba2a-637490db7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:59.347096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72fbcd-a1d5-42e8-ba2a-637490db7755 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:59.347778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72fbcd-a1d5-42e8-ba2a-637490db7755 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:59.348261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72fbcd-a1d5-42e8-ba2a-637490db7755 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:59.350817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72fbcd-a1d5-42e8-ba2a-637490db7755 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:59.354187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72fbcd-a1d5-42e8-ba2a-637490db7755 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:59.378601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 17/40] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 23 10:35:59 2022] POST /identity/v3/roles => generated 223 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:35:59.382102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d9af-8fc0-4d57-8737-300ff241cd08 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:59.382716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d9af-8fc0-4d57-8737-300ff241cd08 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:59.383232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609d9af-8fc0-4d57-8737-300ff241cd08 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:59.384541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905515fd-64ad-4e83-8841-2d72736cc32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:59.385674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905515fd-64ad-4e83-8841-2d72736cc32d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:59.385800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 18/41] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:35:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:35:59.386349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905515fd-64ad-4e83-8841-2d72736cc32d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:59.386803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905515fd-64ad-4e83-8841-2d72736cc32d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:59.388448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905515fd-64ad-4e83-8841-2d72736cc32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:59.390181 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905515fd-64ad-4e83-8841-2d72736cc32d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:59.392264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 24/42] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:35:59.394377 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f3866-e473-4b1a-a4f2-e8572ea64d9e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:59.394842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f3866-e473-4b1a-a4f2-e8572ea64d9e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:59.395327 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f3866-e473-4b1a-a4f2-e8572ea64d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:59.398429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905515fd-64ad-4e83-8841-2d72736cc32d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:59.410964 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:59.421321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-4e4f3866-e473-4b1a-a4f2-e8572ea64d9e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:35:59.423391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4e4f3866-e473-4b1a-a4f2-e8572ea64d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:35:59.514278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 19/43] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:35:59.532592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905515fd-64ad-4e83-8841-2d72736cc32d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:59.537705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f3866-e473-4b1a-a4f2-e8572ea64d9e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:59.577443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93800d33-425d-4c99-9ffe-2bbb6762e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:59.578420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800d33-425d-4c99-9ffe-2bbb6762e7b2 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:59.578716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800d33-425d-4c99-9ffe-2bbb6762e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:59.579000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93800d33-425d-4c99-9ffe-2bbb6762e7b2 None admin] PATH_INFO: `/v3/domains/default/users/a27ae7f7dcd846e6909f95c2447d5f53/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:59.581123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93800d33-425d-4c99-9ffe-2bbb6762e7b2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a27ae7f7dcd846e6909f95c2447d5f53, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:59.582648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93800d33-425d-4c99-9ffe-2bbb6762e7b2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:59.589666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:59.667552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f3866-e473-4b1a-a4f2-e8572ea64d9e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:59.705919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08da3b0-7d56-4fd1-9c45-611d05ede169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:59.706788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08da3b0-7d56-4fd1-9c45-611d05ede169 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:59.707077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08da3b0-7d56-4fd1-9c45-611d05ede169 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:59.707358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08da3b0-7d56-4fd1-9c45-611d05ede169 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:59.708665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08da3b0-7d56-4fd1-9c45-611d05ede169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:59.710171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08da3b0-7d56-4fd1-9c45-611d05ede169 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:59.711933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 20/44] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:35:59.718343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08da3b0-7d56-4fd1-9c45-611d05ede169 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:35:59.810030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 25/45] 10.222.0.39 () {58 vars in 1361 bytes} [Thu Jun 23 10:35:59 2022] PUT /identity/v3/domains/default/users/a27ae7f7dcd846e6909f95c2447d5f53/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:35:59.835018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08da3b0-7d56-4fd1-9c45-611d05ede169 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:35:59.850236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:35:59.889796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152a08e-f97c-4556-b694-efb643b2e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:35:59.890507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152a08e-f97c-4556-b694-efb643b2e95d None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:35:59.890796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152a08e-f97c-4556-b694-efb643b2e95d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:35:59.891077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152a08e-f97c-4556-b694-efb643b2e95d None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:35:59.891828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152a08e-f97c-4556-b694-efb643b2e95d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:35:59.893308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152a08e-f97c-4556-b694-efb643b2e95d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:35:59.920319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 21/46] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:35:59 2022] POST /identity/v3/projects => generated 312 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:36:01.869600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa735ca-ecb0-455c-9851-b14b97ed69e7 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:01.870121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa735ca-ecb0-455c-9851-b14b97ed69e7 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:01.870420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa735ca-ecb0-455c-9851-b14b97ed69e7 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:01.874792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 26/47] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:01.880643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e131fcc-db6f-4991-9e54-dc7cf844dacf None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:01.881083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e131fcc-db6f-4991-9e54-dc7cf844dacf None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:01.881225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e131fcc-db6f-4991-9e54-dc7cf844dacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:01.898857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-6e131fcc-db6f-4991-9e54-dc7cf844dacf None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:01.900639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6e131fcc-db6f-4991-9e54-dc7cf844dacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:01.968606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 22/48] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:01.985375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2bbb1-366f-4b5b-b13b-f03ac2daae62 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:01.985672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2bbb1-366f-4b5b-b13b-f03ac2daae62 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:01.985960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2bbb1-366f-4b5b-b13b-f03ac2daae62 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:01.987378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 27/49] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:01.992532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee177c5-e181-4e85-acfe-a72025f8733d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:01.992828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee177c5-e181-4e85-acfe-a72025f8733d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:01.993117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee177c5-e181-4e85-acfe-a72025f8733d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:01.993281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2bbb1-366f-4b5b-b13b-f03ac2daae62 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:02.010802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-cee177c5-e181-4e85-acfe-a72025f8733d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:02.011999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-cee177c5-e181-4e85-acfe-a72025f8733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:02.061667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:02.079580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 23/50] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:02.105238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2bbb1-366f-4b5b-b13b-f03ac2daae62 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:02.105414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee177c5-e181-4e85-acfe-a72025f8733d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:02.124057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:02.144591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aec47-8751-49e9-8ae9-bac85244a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:02.145382 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aec47-8751-49e9-8ae9-bac85244a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:02.145668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aec47-8751-49e9-8ae9-bac85244a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:02.145950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aec47-8751-49e9-8ae9-bac85244a0a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:02.156438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aec47-8751-49e9-8ae9-bac85244a0a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-6e8aec47-8751-49e9-8ae9-bac85244a0a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:02.164001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:02.164941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:02.166239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 28/51] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:02.171629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aec47-8751-49e9-8ae9-bac85244a0a9 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:02.211904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee177c5-e181-4e85-acfe-a72025f8733d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:02.248669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51feed-b4f7-4bc4-895d-87828416f0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:02.249465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51feed-b4f7-4bc4-895d-87828416f0f8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:02.249749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51feed-b4f7-4bc4-895d-87828416f0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:02.250025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51feed-b4f7-4bc4-895d-87828416f0f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:02.251471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51feed-b4f7-4bc4-895d-87828416f0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:02.252759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51feed-b4f7-4bc4-895d-87828416f0f8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:02.254563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 24/52] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:02.259892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51feed-b4f7-4bc4-895d-87828416f0f8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:02.276372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aec47-8751-49e9-8ae9-bac85244a0a9 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:02.300793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:02.315294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3ea18-4383-4675-86f4-6e36d14d08d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:02.316091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3ea18-4383-4675-86f4-6e36d14d08d1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:02.316417 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3ea18-4383-4675-86f4-6e36d14d08d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:02.316712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3ea18-4383-4675-86f4-6e36d14d08d1 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:02.317657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3ea18-4383-4675-86f4-6e36d14d08d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:02.318085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3ea18-4383-4675-86f4-6e36d14d08d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:02.319939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3ea18-4383-4675-86f4-6e36d14d08d1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:02.336334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 29/53] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:02.343697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3ea18-4383-4675-86f4-6e36d14d08d1 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:02.347610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:02.363628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51feed-b4f7-4bc4-895d-87828416f0f8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:02.457379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3ea18-4383-4675-86f4-6e36d14d08d1 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:02.496233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3645a-d92a-4514-82b8-561741fff2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:02.497109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3645a-d92a-4514-82b8-561741fff2e8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:02.497397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3645a-d92a-4514-82b8-561741fff2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:02.497677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3645a-d92a-4514-82b8-561741fff2e8 None admin] PATH_INFO: `/v3/users/a27ae7f7dcd846e6909f95c2447d5f53` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:02.498988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3645a-d92a-4514-82b8-561741fff2e8 None admin] RBAC: Authorizing `identity:get_user(user_id=a27ae7f7dcd846e6909f95c2447d5f53)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:02.500457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3645a-d92a-4514-82b8-561741fff2e8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:02.502111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 30/54] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:02 2022] GET /identity/v3/users/a27ae7f7dcd846e6909f95c2447d5f53 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:02.507447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3645a-d92a-4514-82b8-561741fff2e8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:02.510138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57486a-b63b-44da-b866-4e6b3c3b6f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:02.510885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57486a-b63b-44da-b866-4e6b3c3b6f77 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:02.511179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57486a-b63b-44da-b866-4e6b3c3b6f77 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:02.511471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57486a-b63b-44da-b866-4e6b3c3b6f77 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:02.512211 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57486a-b63b-44da-b866-4e6b3c3b6f77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:02.513685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57486a-b63b-44da-b866-4e6b3c3b6f77 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:02.552270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 25/55] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jun 23 10:36:02 2022] POST /identity/v3/projects => generated 298 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:36:02.573643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:02.624668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3645a-d92a-4514-82b8-561741fff2e8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:02.663838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393925d-5b82-439d-b3bd-f40e828bd80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:02.664647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393925d-5b82-439d-b3bd-f40e828bd80f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:02.664933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393925d-5b82-439d-b3bd-f40e828bd80f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:02.665215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393925d-5b82-439d-b3bd-f40e828bd80f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:02.667206 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393925d-5b82-439d-b3bd-f40e828bd80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:02.668693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393925d-5b82-439d-b3bd-f40e828bd80f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:02.670783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 31/56] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:02.676295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57486a-b63b-44da-b866-4e6b3c3b6f77 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:02.781941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57486a-b63b-44da-b866-4e6b3c3b6f77 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:02.816439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad7fcf-5288-420d-8d25-cf97066d68da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:02.817105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad7fcf-5288-420d-8d25-cf97066d68da None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:02.817396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad7fcf-5288-420d-8d25-cf97066d68da None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:02.817682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad7fcf-5288-420d-8d25-cf97066d68da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:02.818558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad7fcf-5288-420d-8d25-cf97066d68da None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.domain.id=default, user.id=a27ae7f7dcd846e6909f95c2447d5f53) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:02.818883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad7fcf-5288-420d-8d25-cf97066d68da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:02.820338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad7fcf-5288-420d-8d25-cf97066d68da None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:02.829551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 26/57] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jun 23 10:36:02 2022] GET /identity/v3/role_assignments?user.id=a27ae7f7dcd846e6909f95c2447d5f53&scope.domain.id=default&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:04.608781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca5dd1-913b-470e-9e1a-6d414e4162d1 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:04.609287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca5dd1-913b-470e-9e1a-6d414e4162d1 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:04.609404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca5dd1-913b-470e-9e1a-6d414e4162d1 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:04.610772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 32/58] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:04.616557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e65c3-90bb-4d0b-ac5e-2233c897d32e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:04.616993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e65c3-90bb-4d0b-ac5e-2233c897d32e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:04.617125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e65c3-90bb-4d0b-ac5e-2233c897d32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:04.622999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:04.637291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d55e65c3-90bb-4d0b-ac5e-2233c897d32e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:04.638840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d55e65c3-90bb-4d0b-ac5e-2233c897d32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:04.707198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 27/59] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:04.733613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca5dd1-913b-470e-9e1a-6d414e4162d1 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:04.840043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca5dd1-913b-470e-9e1a-6d414e4162d1 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:04.863377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:04.875635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7293b5-fe24-46ec-88ff-9303b9541a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:04.876429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7293b5-fe24-46ec-88ff-9303b9541a62 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:04.876720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7293b5-fe24-46ec-88ff-9303b9541a62 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:04.877004 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7293b5-fe24-46ec-88ff-9303b9541a62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:04.878221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7293b5-fe24-46ec-88ff-9303b9541a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:04.879812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7293b5-fe24-46ec-88ff-9303b9541a62 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:04.881450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 33/60] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:04.887361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e65c3-90bb-4d0b-ac5e-2233c897d32e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:04.989744 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e65c3-90bb-4d0b-ac5e-2233c897d32e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:05.020166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:05.026622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c8add-e814-49cd-834a-5a11a5acf230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:05.027307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c8add-e814-49cd-834a-5a11a5acf230 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:05.027597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c8add-e814-49cd-834a-5a11a5acf230 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:05.027876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c8add-e814-49cd-834a-5a11a5acf230 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:05.028601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c8add-e814-49cd-834a-5a11a5acf230 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:05.030064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c8add-e814-49cd-834a-5a11a5acf230 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:05.055570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 28/61] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:36:04 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:36:08.547278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47473f00-99e2-4146-a0ae-3c6647bb9169 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:08.548275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47473f00-99e2-4146-a0ae-3c6647bb9169 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:08.548792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47473f00-99e2-4146-a0ae-3c6647bb9169 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:08.550407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 34/62] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:08.556247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2557a-6862-4073-9466-3a27207f4ef9 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:08.557199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2557a-6862-4073-9466-3a27207f4ef9 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:08.557676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2557a-6862-4073-9466-3a27207f4ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:08.581399 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-92b2557a-6862-4073-9466-3a27207f4ef9 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:08.583185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-92b2557a-6862-4073-9466-3a27207f4ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:08.690416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 29/63] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:08.694154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b252b0-913c-4d0a-9f53-95c426a4e1f7 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:08.694700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b252b0-913c-4d0a-9f53-95c426a4e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:08.695193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b252b0-913c-4d0a-9f53-95c426a4e1f7 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:08.698028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 35/64] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:08.703743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4dff8-90eb-444b-a6f6-c65bcd0b6c6d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:08.704123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4dff8-90eb-444b-a6f6-c65bcd0b6c6d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:08.704367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4dff8-90eb-444b-a6f6-c65bcd0b6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:08.714352 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b252b0-913c-4d0a-9f53-95c426a4e1f7 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:08.726903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-84c4dff8-90eb-444b-a6f6-c65bcd0b6c6d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:08.728701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-84c4dff8-90eb-444b-a6f6-c65bcd0b6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:08.840440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 30/65] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:08.841600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d154b5-661b-4b0b-b1e3-b7980f3bb772 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:08.841899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d154b5-661b-4b0b-b1e3-b7980f3bb772 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:08.842186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d154b5-661b-4b0b-b1e3-b7980f3bb772 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:08.852146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 31/66] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:08.860735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337b17e-20ee-49a8-9299-e9f2d253350d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:08.861024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337b17e-20ee-49a8-9299-e9f2d253350d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:08.861319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337b17e-20ee-49a8-9299-e9f2d253350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:08.881566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b252b0-913c-4d0a-9f53-95c426a4e1f7 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:08.891797 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-4337b17e-20ee-49a8-9299-e9f2d253350d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:08.893043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4337b17e-20ee-49a8-9299-e9f2d253350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:08.925266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84a7e-2ed7-480c-9b44-f5f210045c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:08.926575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84a7e-2ed7-480c-9b44-f5f210045c85 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:08.926875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84a7e-2ed7-480c-9b44-f5f210045c85 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:08.927434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84a7e-2ed7-480c-9b44-f5f210045c85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:08.941512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb84a7e-2ed7-480c-9b44-f5f210045c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:08.947625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-fcb84a7e-2ed7-480c-9b44-f5f210045c85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:08.952182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:08.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:08.953857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 36/67] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:08.955039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84a7e-2ed7-480c-9b44-f5f210045c85 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:08.984546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 32/68] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:08.985435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337b17e-20ee-49a8-9299-e9f2d253350d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:09.020849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:09.089608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84a7e-2ed7-480c-9b44-f5f210045c85 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:09.126280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1e133-8214-4b8b-ba09-008e2dec187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:09.128350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337b17e-20ee-49a8-9299-e9f2d253350d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:09.128837 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1e133-8214-4b8b-ba09-008e2dec187d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.129135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1e133-8214-4b8b-ba09-008e2dec187d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.129420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1e133-8214-4b8b-ba09-008e2dec187d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.140130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1e133-8214-4b8b-ba09-008e2dec187d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-e3c1e133-8214-4b8b-ba09-008e2dec187d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:09.147834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:09.148721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:09.149529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 37/69] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:09.150769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1e133-8214-4b8b-ba09-008e2dec187d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:09.168614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c182af-8661-43f1-b22b-285ab78bac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:09.169289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c182af-8661-43f1-b22b-285ab78bac2e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.169575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c182af-8661-43f1-b22b-285ab78bac2e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.169854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c182af-8661-43f1-b22b-285ab78bac2e None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.170650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c182af-8661-43f1-b22b-285ab78bac2e None admin] RBAC: Adding query filter params (name=member) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:09.170956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c182af-8661-43f1-b22b-285ab78bac2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:09.172365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c182af-8661-43f1-b22b-285ab78bac2e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:09.180798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 33/70] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:09.182434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f00922-0ed9-4072-8f9c-fcbd8c495422 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.182730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f00922-0ed9-4072-8f9c-fcbd8c495422 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.183011 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f00922-0ed9-4072-8f9c-fcbd8c495422 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.184458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 34/71] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:09.185526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd92f5-7c4c-4c27-9ecd-aa0f70e635d4 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.185825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd92f5-7c4c-4c27-9ecd-aa0f70e635d4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.186111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd92f5-7c4c-4c27-9ecd-aa0f70e635d4 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.187440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 35/72] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:09.190480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd92f5-7c4c-4c27-9ecd-aa0f70e635d4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:09.234007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:09.266782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1e133-8214-4b8b-ba09-008e2dec187d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:09.279627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:09.296981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd92f5-7c4c-4c27-9ecd-aa0f70e635d4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:09.304959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f627546-6295-45f3-b521-d586d5ad41e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:09.305771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f627546-6295-45f3-b521-d586d5ad41e4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.306105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f627546-6295-45f3-b521-d586d5ad41e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.306417 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f627546-6295-45f3-b521-d586d5ad41e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.317781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f627546-6295-45f3-b521-d586d5ad41e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-0f627546-6295-45f3-b521-d586d5ad41e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:09.326012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:09.326961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:09.327965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 38/73] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:09.328879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f627546-6295-45f3-b521-d586d5ad41e4 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:09.333922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41ee14-16dc-4e70-bbbd-9fa05fe21af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:09.334654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41ee14-16dc-4e70-bbbd-9fa05fe21af6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.334950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41ee14-16dc-4e70-bbbd-9fa05fe21af6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.335235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41ee14-16dc-4e70-bbbd-9fa05fe21af6 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.336012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41ee14-16dc-4e70-bbbd-9fa05fe21af6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:09.336327 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41ee14-16dc-4e70-bbbd-9fa05fe21af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:09.338532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41ee14-16dc-4e70-bbbd-9fa05fe21af6 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:09.348000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 36/74] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:09.349318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9adca-1f57-44ef-9249-ce357d2868b3 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.349617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9adca-1f57-44ef-9249-ce357d2868b3 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.349903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9adca-1f57-44ef-9249-ce357d2868b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.367152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-21e9adca-1f57-44ef-9249-ce357d2868b3 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:09.368390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-21e9adca-1f57-44ef-9249-ce357d2868b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:09.440774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 37/75] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:09.441994 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a88ad-0c04-46f2-aa95-69ea6d1c6dd4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.442285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a88ad-0c04-46f2-aa95-69ea6d1c6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.442597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a88ad-0c04-46f2-aa95-69ea6d1c6dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.458683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f627546-6295-45f3-b521-d586d5ad41e4 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:09.460600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-990a88ad-0c04-46f2-aa95-69ea6d1c6dd4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:09.461821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-990a88ad-0c04-46f2-aa95-69ea6d1c6dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:09.493551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:09.499761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b51993-9b2f-406b-8096-2d709e37dcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:09.500645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b51993-9b2f-406b-8096-2d709e37dcff None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.500933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b51993-9b2f-406b-8096-2d709e37dcff None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.501218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b51993-9b2f-406b-8096-2d709e37dcff None admin] PATH_INFO: `/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.516683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b51993-9b2f-406b-8096-2d709e37dcff None admin] RBAC: Authorizing `identity:get_user(user_id=ec4709eda5dd45ea8a9d35bf7da1f22b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:09.518605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b51993-9b2f-406b-8096-2d709e37dcff None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:09.520283 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 39/76] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:09 2022] GET /identity/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:09.521089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b51993-9b2f-406b-8096-2d709e37dcff None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:09.535066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 38/77] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:09.536246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a88ad-0c04-46f2-aa95-69ea6d1c6dd4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:09.563336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:09.642180 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b51993-9b2f-406b-8096-2d709e37dcff None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:09.652061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a88ad-0c04-46f2-aa95-69ea6d1c6dd4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:09.678881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16f479-04d0-4d3c-96a8-58709d4d70eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:09.679550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16f479-04d0-4d3c-96a8-58709d4d70eb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.679835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16f479-04d0-4d3c-96a8-58709d4d70eb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.680113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16f479-04d0-4d3c-96a8-58709d4d70eb None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.680867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16f479-04d0-4d3c-96a8-58709d4d70eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:09.681783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16f479-04d0-4d3c-96a8-58709d4d70eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:09.684230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16f479-04d0-4d3c-96a8-58709d4d70eb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:09.687370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe302-0b4c-4f7d-a135-45180efcfbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:09.688239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe302-0b4c-4f7d-a135-45180efcfbf5 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.688521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe302-0b4c-4f7d-a135-45180efcfbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.688798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe302-0b4c-4f7d-a135-45180efcfbf5 None admin] PATH_INFO: `/v3/users/a27ae7f7dcd846e6909f95c2447d5f53` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.690278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe302-0b4c-4f7d-a135-45180efcfbf5 None admin] RBAC: Authorizing `identity:get_user(user_id=a27ae7f7dcd846e6909f95c2447d5f53)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:09.691830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe302-0b4c-4f7d-a135-45180efcfbf5 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:09.698852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 40/78] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:09.699020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 39/79] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:09 2022] GET /identity/v3/users/a27ae7f7dcd846e6909f95c2447d5f53 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:09.699020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe302-0b4c-4f7d-a135-45180efcfbf5 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:09.699170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16f479-04d0-4d3c-96a8-58709d4d70eb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:09.732915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:09.799961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:09.807097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe302-0b4c-4f7d-a135-45180efcfbf5 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:09.810538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16f479-04d0-4d3c-96a8-58709d4d70eb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:09.847178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cf1b6-8266-48f2-b089-dbecc429de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:09.847692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8429653-8d3e-40e3-ae58-2fabe39ecb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:09.847974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cf1b6-8266-48f2-b089-dbecc429de64 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.848262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cf1b6-8266-48f2-b089-dbecc429de64 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.848348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429653-8d3e-40e3-ae58-2fabe39ecb0e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:09.848542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cf1b6-8266-48f2-b089-dbecc429de64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.848638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429653-8d3e-40e3-ae58-2fabe39ecb0e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:09.848887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429653-8d3e-40e3-ae58-2fabe39ecb0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:09.849740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cf1b6-8266-48f2-b089-dbecc429de64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:09.851234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cf1b6-8266-48f2-b089-dbecc429de64 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:09.852906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 41/80] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:09.853658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cf1b6-8266-48f2-b089-dbecc429de64 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:09.921179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429653-8d3e-40e3-ae58-2fabe39ecb0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:09.922745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429653-8d3e-40e3-ae58-2fabe39ecb0e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:09.957026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:09.960620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cf1b6-8266-48f2-b089-dbecc429de64 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:10.000952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f84ee-8021-49be-ae55-f97f0cbec248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:10.002212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f84ee-8021-49be-ae55-f97f0cbec248 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:10.002706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f84ee-8021-49be-ae55-f97f0cbec248 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:10.003167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f84ee-8021-49be-ae55-f97f0cbec248 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:10.020198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f84ee-8021-49be-ae55-f97f0cbec248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-9b9f84ee-8021-49be-ae55-f97f0cbec248 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:10.034854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:10.035859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:10.036637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:10.037224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 42/81] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:10.038149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f84ee-8021-49be-ae55-f97f0cbec248 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:10.054404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 40/82] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:10.055272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8429653-8d3e-40e3-ae58-2fabe39ecb0e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:10.067836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:10.153980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f84ee-8021-49be-ae55-f97f0cbec248 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:10.158403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8429653-8d3e-40e3-ae58-2fabe39ecb0e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:10.188681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d2d7-7d34-433f-88cf-3849bbbf79cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:10.189809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d2d7-7d34-433f-88cf-3849bbbf79cb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:10.190102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d2d7-7d34-433f-88cf-3849bbbf79cb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:10.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:10.190486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d2d7-7d34-433f-88cf-3849bbbf79cb None admin] PATH_INFO: `/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:10.191661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2d2d7-7d34-433f-88cf-3849bbbf79cb None admin] RBAC: Authorizing `identity:get_user(user_id=ec4709eda5dd45ea8a9d35bf7da1f22b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:10.193440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2d2d7-7d34-433f-88cf-3849bbbf79cb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:10.195253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 43/83] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:10 2022] GET /identity/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:10.195906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d2d7-7d34-433f-88cf-3849bbbf79cb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:10.201911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88e378-c954-473b-b0b6-8e384ba81467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:10.202621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88e378-c954-473b-b0b6-8e384ba81467 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:10.202915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88e378-c954-473b-b0b6-8e384ba81467 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:10.203202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88e378-c954-473b-b0b6-8e384ba81467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:10.272233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88e378-c954-473b-b0b6-8e384ba81467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:10.273663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88e378-c954-473b-b0b6-8e384ba81467 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:10.288847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:10.307163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d2d7-7d34-433f-88cf-3849bbbf79cb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:10.346762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d70a9-2906-4331-81d1-1d32991fdf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:10.347448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d70a9-2906-4331-81d1-1d32991fdf36 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:10.347736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d70a9-2906-4331-81d1-1d32991fdf36 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:10.348022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d70a9-2906-4331-81d1-1d32991fdf36 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:10.348791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d70a9-2906-4331-81d1-1d32991fdf36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:10.350284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d70a9-2906-4331-81d1-1d32991fdf36 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:10.381178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 44/84] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:36:10 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:36:10.382027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d70a9-2906-4331-81d1-1d32991fdf36 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:10.394096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 41/85] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:10.395686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88e378-c954-473b-b0b6-8e384ba81467 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:10.436272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:10.544367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d70a9-2906-4331-81d1-1d32991fdf36 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:10.549058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88e378-c954-473b-b0b6-8e384ba81467 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:10.589448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed0d73-6e50-44d3-8d1c-87b9853f4579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:10.590173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0d73-6e50-44d3-8d1c-87b9853f4579 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:10.590444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0d73-6e50-44d3-8d1c-87b9853f4579 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:10.590728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed0d73-6e50-44d3-8d1c-87b9853f4579 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:10.591494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0d73-6e50-44d3-8d1c-87b9853f4579 None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:10.591801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0d73-6e50-44d3-8d1c-87b9853f4579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:10.593215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed0d73-6e50-44d3-8d1c-87b9853f4579 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:10.597393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5f80-e8c9-45ba-8540-c948e22a423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:10.598276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5f80-e8c9-45ba-8540-c948e22a423d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:10.598613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5f80-e8c9-45ba-8540-c948e22a423d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:10.598899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a5f80-e8c9-45ba-8540-c948e22a423d None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:10.600901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a5f80-e8c9-45ba-8540-c948e22a423d None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:10.602480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a5f80-e8c9-45ba-8540-c948e22a423d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:10.603863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 45/86] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:10.604714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed0d73-6e50-44d3-8d1c-87b9853f4579 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:10.604846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 42/87] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:10 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:10.605628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5f80-e8c9-45ba-8540-c948e22a423d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:10.614567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:10.746251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:10.751505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a5f80-e8c9-45ba-8540-c948e22a423d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:10.757697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed0d73-6e50-44d3-8d1c-87b9853f4579 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:10.792592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ddde2-864b-492e-83d8-f846e92b4717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:10.793343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ddde2-864b-492e-83d8-f846e92b4717 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:10.793637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ddde2-864b-492e-83d8-f846e92b4717 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:10.793922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ddde2-864b-492e-83d8-f846e92b4717 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:10.795210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ddde2-864b-492e-83d8-f846e92b4717 None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:10.796684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ddde2-864b-492e-83d8-f846e92b4717 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:10.799267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 43/88] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:10 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:10.800100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ddde2-864b-492e-83d8-f846e92b4717 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:10.807207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7a17-e7e3-4676-b9f3-d91b2a153df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:10.807876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7a17-e7e3-4676-b9f3-d91b2a153df9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:10.808168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7a17-e7e3-4676-b9f3-d91b2a153df9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:10.808459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf7a17-e7e3-4676-b9f3-d91b2a153df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:10.908467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf7a17-e7e3-4676-b9f3-d91b2a153df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:10.910001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf7a17-e7e3-4676-b9f3-d91b2a153df9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:10.913059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:10.933942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ddde2-864b-492e-83d8-f846e92b4717 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:10.971378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe3c09-1a8e-4a33-b56b-2f8f7b7932af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:10.971967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe3c09-1a8e-4a33-b56b-2f8f7b7932af None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:10.972260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe3c09-1a8e-4a33-b56b-2f8f7b7932af None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:10.972546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe3c09-1a8e-4a33-b56b-2f8f7b7932af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:10.973407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe3c09-1a8e-4a33-b56b-2f8f7b7932af None admin] RBAC: Adding query filter params (role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=e516b1510c304deca52090a8334ae8fd, user.id=ec4709eda5dd45ea8a9d35bf7da1f22b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:10.973725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe3c09-1a8e-4a33-b56b-2f8f7b7932af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:10.975225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe3c09-1a8e-4a33-b56b-2f8f7b7932af None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:10.982164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 44/89] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:10 2022] GET /identity/v3/role_assignments?user.id=ec4709eda5dd45ea8a9d35bf7da1f22b&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:10.983099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe3c09-1a8e-4a33-b56b-2f8f7b7932af None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:11.017930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:11.083088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 46/90] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:11.084051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7a17-e7e3-4676-b9f3-d91b2a153df9 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:11.107072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe3c09-1a8e-4a33-b56b-2f8f7b7932af None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:11.159601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efbc57-395f-4407-ba93-eb01c912feb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:11.161249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efbc57-395f-4407-ba93-eb01c912feb2 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:11.161780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efbc57-395f-4407-ba93-eb01c912feb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:11.162302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efbc57-395f-4407-ba93-eb01c912feb2 None admin] PATH_INFO: `/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:11.167576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efbc57-395f-4407-ba93-eb01c912feb2 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4709eda5dd45ea8a9d35bf7da1f22b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:11.169084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efbc57-395f-4407-ba93-eb01c912feb2 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:11.170921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 45/91] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:10 2022] GET /identity/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:11.178246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efbc57-395f-4407-ba93-eb01c912feb2 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:11.274419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf7a17-e7e3-4676-b9f3-d91b2a153df9 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:11.280425 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:11.361044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3454b14-c4aa-4930-a650-406ac214b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:11.363152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3454b14-c4aa-4930-a650-406ac214b270 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:11.365192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3454b14-c4aa-4930-a650-406ac214b270 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:11.365732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3454b14-c4aa-4930-a650-406ac214b270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:11.368305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3454b14-c4aa-4930-a650-406ac214b270 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=e516b1510c304deca52090a8334ae8fd, user.id=a27ae7f7dcd846e6909f95c2447d5f53) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:11.370433 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3454b14-c4aa-4930-a650-406ac214b270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:11.372173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3454b14-c4aa-4930-a650-406ac214b270 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:11.381364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 47/92] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:11 2022] GET /identity/v3/role_assignments?user.id=a27ae7f7dcd846e6909f95c2447d5f53&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:11.382885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3454b14-c4aa-4930-a650-406ac214b270 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:11.392225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:11.405361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efbc57-395f-4407-ba93-eb01c912feb2 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:11.448529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2683627-84b9-462e-8aa6-92050059c414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:11.449812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683627-84b9-462e-8aa6-92050059c414 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:11.450310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683627-84b9-462e-8aa6-92050059c414 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:11.450822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2683627-84b9-462e-8aa6-92050059c414 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:11.452346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2683627-84b9-462e-8aa6-92050059c414 None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:11.454051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2683627-84b9-462e-8aa6-92050059c414 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:11.456207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 46/93] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:11 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:11.465142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2683627-84b9-462e-8aa6-92050059c414 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:11.616608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2683627-84b9-462e-8aa6-92050059c414 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:11.666265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f8bc-a04b-43d1-9807-ecc5d7fa5f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:11.667049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f8bc-a04b-43d1-9807-ecc5d7fa5f4f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:11.667334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f8bc-a04b-43d1-9807-ecc5d7fa5f4f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:11.667613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f8bc-a04b-43d1-9807-ecc5d7fa5f4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:11.668478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3f8bc-a04b-43d1-9807-ecc5d7fa5f4f None admin] RBAC: Adding query filter params (role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=e516b1510c304deca52090a8334ae8fd, user.id=ec4709eda5dd45ea8a9d35bf7da1f22b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:11.668794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3f8bc-a04b-43d1-9807-ecc5d7fa5f4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:11.670348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3f8bc-a04b-43d1-9807-ecc5d7fa5f4f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:11.687823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 47/94] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:11 2022] GET /identity/v3/role_assignments?user.id=ec4709eda5dd45ea8a9d35bf7da1f22b&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:11.690235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3454b14-c4aa-4930-a650-406ac214b270 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:11.734126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb655ad2-65e2-4a73-b3fb-ebbfdd01d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:11.734940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb655ad2-65e2-4a73-b3fb-ebbfdd01d862 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:11.735233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb655ad2-65e2-4a73-b3fb-ebbfdd01d862 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:11.735512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb655ad2-65e2-4a73-b3fb-ebbfdd01d862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:11.781409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:11.823786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb655ad2-65e2-4a73-b3fb-ebbfdd01d862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:11.825312 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb655ad2-65e2-4a73-b3fb-ebbfdd01d862 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:11.949705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 48/95] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:11.955941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f8bc-a04b-43d1-9807-ecc5d7fa5f4f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:11.999666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:12.090297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f8bc-a04b-43d1-9807-ecc5d7fa5f4f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:12.134092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60a5f9-69ad-4276-abf3-4fdefaac69cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:12.135242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a5f9-69ad-4276-abf3-4fdefaac69cc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:12.135532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a5f9-69ad-4276-abf3-4fdefaac69cc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:12.135819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a5f9-69ad-4276-abf3-4fdefaac69cc None admin] PATH_INFO: `/v3/projects/90598103e6b947a6aa99bed64829bb5b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:12.137197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a5f9-69ad-4276-abf3-4fdefaac69cc None admin] RBAC: Authorizing `identity:get_project(project_id=90598103e6b947a6aa99bed64829bb5b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:12.138689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a5f9-69ad-4276-abf3-4fdefaac69cc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:12.140457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 48/96] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:11 2022] GET /identity/v3/projects/90598103e6b947a6aa99bed64829bb5b => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:12.146531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb655ad2-65e2-4a73-b3fb-ebbfdd01d862 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:12.241266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:12.298565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb655ad2-65e2-4a73-b3fb-ebbfdd01d862 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:12.357948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fddbe4-d358-494a-9176-9de5c0fdb9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:12.358650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fddbe4-d358-494a-9176-9de5c0fdb9aa None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:12.358936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fddbe4-d358-494a-9176-9de5c0fdb9aa None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:12.359217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fddbe4-d358-494a-9176-9de5c0fdb9aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:12.360234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fddbe4-d358-494a-9176-9de5c0fdb9aa None admin] RBAC: Adding query filter params (role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=90598103e6b947a6aa99bed64829bb5b, user.id=ec4709eda5dd45ea8a9d35bf7da1f22b) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:12.360555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fddbe4-d358-494a-9176-9de5c0fdb9aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:12.362482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fddbe4-d358-494a-9176-9de5c0fdb9aa None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:12.369094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 49/97] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:12 2022] GET /identity/v3/role_assignments?user.id=ec4709eda5dd45ea8a9d35bf7da1f22b&scope.project.id=90598103e6b947a6aa99bed64829bb5b&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:13.293350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360eb1-c2fd-4b22-8032-efbd1a3966d2 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:13.294156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360eb1-c2fd-4b22-8032-efbd1a3966d2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:13.294156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360eb1-c2fd-4b22-8032-efbd1a3966d2 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:13.295514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 49/98] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:13.312879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61feb69-f4f5-47ce-a066-1fcf2af04de8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:13.313534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61feb69-f4f5-47ce-a066-1fcf2af04de8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:13.313534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61feb69-f4f5-47ce-a066-1fcf2af04de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:13.335434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c61feb69-f4f5-47ce-a066-1fcf2af04de8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:13.337375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c61feb69-f4f5-47ce-a066-1fcf2af04de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:13.427614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 50/99] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:13.459467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5360eb1-c2fd-4b22-8032-efbd1a3966d2 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:13.584426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:13.596277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5360eb1-c2fd-4b22-8032-efbd1a3966d2 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:13.650697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cccf39-6662-4ba2-a830-0d032e06e204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:13.651624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cccf39-6662-4ba2-a830-0d032e06e204 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:13.651915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cccf39-6662-4ba2-a830-0d032e06e204 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:13.652182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cccf39-6662-4ba2-a830-0d032e06e204 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:13.668829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cccf39-6662-4ba2-a830-0d032e06e204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-87cccf39-6662-4ba2-a830-0d032e06e204 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:13.676630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:13.677579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:13.678414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 50/100] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:13.685060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61feb69-f4f5-47ce-a066-1fcf2af04de8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:13.791161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053398e-468c-43cf-9316-d539d0537d00 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:13.791534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053398e-468c-43cf-9316-d539d0537d00 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:13.791767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053398e-468c-43cf-9316-d539d0537d00 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:13.793436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 51/101] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:13.799657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250da700-fada-4c42-a8f8-ebadea323efc None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:13.800261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250da700-fada-4c42-a8f8-ebadea323efc None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:13.800564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250da700-fada-4c42-a8f8-ebadea323efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:13.806729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:13.834290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-250da700-fada-4c42-a8f8-ebadea323efc None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:13.835593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-250da700-fada-4c42-a8f8-ebadea323efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:13.867585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61feb69-f4f5-47ce-a066-1fcf2af04de8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:13.905434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677d3b4-fd5d-425b-b267-5442ac6be076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:13.906109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677d3b4-fd5d-425b-b267-5442ac6be076 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:13.906428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677d3b4-fd5d-425b-b267-5442ac6be076 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:13.906714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677d3b4-fd5d-425b-b267-5442ac6be076 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:13.907589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677d3b4-fd5d-425b-b267-5442ac6be076 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:13.907905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677d3b4-fd5d-425b-b267-5442ac6be076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:13.909299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677d3b4-fd5d-425b-b267-5442ac6be076 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:13.918632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 51/102] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:13.919844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ea21-6a29-4e85-b10e-c3087be92cc3 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:13.920143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ea21-6a29-4e85-b10e-c3087be92cc3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:13.920421 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6ea21-6a29-4e85-b10e-c3087be92cc3 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:13.921957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 52/103] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:13.926874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6ea21-6a29-4e85-b10e-c3087be92cc3 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:13.995914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 52/104] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:13.997425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da24e-4696-40ee-bb74-b386fe0653e8 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:13.997720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da24e-4696-40ee-bb74-b386fe0653e8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:13.998003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da24e-4696-40ee-bb74-b386fe0653e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:14.017887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-946da24e-4696-40ee-bb74-b386fe0653e8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:14.019403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-946da24e-4696-40ee-bb74-b386fe0653e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:14.113322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6ea21-6a29-4e85-b10e-c3087be92cc3 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:14.145737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:14.158108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8728-dcea-4a93-a668-fb242ed262f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:14.159133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8728-dcea-4a93-a668-fb242ed262f6 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:14.159533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8728-dcea-4a93-a668-fb242ed262f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:14.159816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d8728-dcea-4a93-a668-fb242ed262f6 None admin] PATH_INFO: `/v3/users/851ddf2e4d904421876928dbfdf30361` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:14.160642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 53/105] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:14.161583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946da24e-4696-40ee-bb74-b386fe0653e8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:14.191395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:14.191845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d8728-dcea-4a93-a668-fb242ed262f6 None admin] RBAC: Authorizing `identity:get_user(user_id=851ddf2e4d904421876928dbfdf30361)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:14.193476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d8728-dcea-4a93-a668-fb242ed262f6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:14.195596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 53/106] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:13 2022] GET /identity/v3/users/851ddf2e4d904421876928dbfdf30361 => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:14.201776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8728-dcea-4a93-a668-fb242ed262f6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:14.289719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946da24e-4696-40ee-bb74-b386fe0653e8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:14.335268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f67f7-573f-4635-9c3b-339315ee8159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:14.335928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d8728-dcea-4a93-a668-fb242ed262f6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:14.336410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f67f7-573f-4635-9c3b-339315ee8159 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:14.336410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f67f7-573f-4635-9c3b-339315ee8159 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:14.336648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f67f7-573f-4635-9c3b-339315ee8159 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:14.347464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f67f7-573f-4635-9c3b-339315ee8159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-889f67f7-573f-4635-9c3b-339315ee8159 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:14.356069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:14.358641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 54/107] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:14.361246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f67f7-573f-4635-9c3b-339315ee8159 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:14.374203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b0134-1e6e-4fb2-956e-2b2bacfc6eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:14.374863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b0134-1e6e-4fb2-956e-2b2bacfc6eb2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:14.375148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b0134-1e6e-4fb2-956e-2b2bacfc6eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:14.375429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b0134-1e6e-4fb2-956e-2b2bacfc6eb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:14.432934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:14.467489 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b0134-1e6e-4fb2-956e-2b2bacfc6eb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:14.470413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b0134-1e6e-4fb2-956e-2b2bacfc6eb2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:14.521267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:14.589282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f67f7-573f-4635-9c3b-339315ee8159 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:14.597466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 54/108] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:14.598125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b0134-1e6e-4fb2-956e-2b2bacfc6eb2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:14.690206 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:14.701393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444d41-5290-44f0-80c9-efd2edcdc255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:14.702215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444d41-5290-44f0-80c9-efd2edcdc255 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:14.702534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444d41-5290-44f0-80c9-efd2edcdc255 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:14.702819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444d41-5290-44f0-80c9-efd2edcdc255 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:14.704615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b0134-1e6e-4fb2-956e-2b2bacfc6eb2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:14.706768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5444d41-5290-44f0-80c9-efd2edcdc255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:14.708384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5444d41-5290-44f0-80c9-efd2edcdc255 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:14.710363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 55/109] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:14.711160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444d41-5290-44f0-80c9-efd2edcdc255 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:14.746570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071e8e-ebcf-445a-86a6-3da69e79a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:14.747321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071e8e-ebcf-445a-86a6-3da69e79a97e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:14.747608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071e8e-ebcf-445a-86a6-3da69e79a97e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:14.747892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b071e8e-ebcf-445a-86a6-3da69e79a97e None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:14.748702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b071e8e-ebcf-445a-86a6-3da69e79a97e None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:14.749016 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b071e8e-ebcf-445a-86a6-3da69e79a97e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:14.750455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b071e8e-ebcf-445a-86a6-3da69e79a97e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:14.761506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 55/110] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:14.762390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071e8e-ebcf-445a-86a6-3da69e79a97e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:14.866883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b071e8e-ebcf-445a-86a6-3da69e79a97e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:14.913518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444d41-5290-44f0-80c9-efd2edcdc255 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:14.917042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546be1-cb12-4b5a-9939-9e7c6fcb96ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:14.917723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546be1-cb12-4b5a-9939-9e7c6fcb96ef None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:14.918009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546be1-cb12-4b5a-9939-9e7c6fcb96ef None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:14.918291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6546be1-cb12-4b5a-9939-9e7c6fcb96ef None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:14.919116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6546be1-cb12-4b5a-9939-9e7c6fcb96ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:14.920670 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6546be1-cb12-4b5a-9939-9e7c6fcb96ef None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:14.946178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:14.969048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 56/111] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:36:14 2022] POST /identity/v3/projects => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:36:14.969923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546be1-cb12-4b5a-9939-9e7c6fcb96ef None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:15.003671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489437f2-006e-497a-adf4-b57def4053d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:15.004556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489437f2-006e-497a-adf4-b57def4053d6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.004892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489437f2-006e-497a-adf4-b57def4053d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.005184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489437f2-006e-497a-adf4-b57def4053d6 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.006585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489437f2-006e-497a-adf4-b57def4053d6 None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:15.008233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489437f2-006e-497a-adf4-b57def4053d6 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:15.010348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 56/112] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:14 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:15.016628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489437f2-006e-497a-adf4-b57def4053d6 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:15.047581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:15.138897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6546be1-cb12-4b5a-9939-9e7c6fcb96ef None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:15.180650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded2daf-ebb5-495e-b164-6c5c8f7515cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:15.182311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2daf-ebb5-495e-b164-6c5c8f7515cb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.182642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2daf-ebb5-495e-b164-6c5c8f7515cb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.182925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2daf-ebb5-495e-b164-6c5c8f7515cb None admin] PATH_INFO: `/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.191007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded2daf-ebb5-495e-b164-6c5c8f7515cb None admin] RBAC: Authorizing `identity:get_user(user_id=ec4709eda5dd45ea8a9d35bf7da1f22b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:15.192548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded2daf-ebb5-495e-b164-6c5c8f7515cb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:15.196481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 57/113] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:14 2022] GET /identity/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:15.199474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434580cb-be58-4b58-999d-554450085834 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.199877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434580cb-be58-4b58-999d-554450085834 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.200071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434580cb-be58-4b58-999d-554450085834 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.203339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 58/114] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:15.206123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434580cb-be58-4b58-999d-554450085834 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:15.238599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489437f2-006e-497a-adf4-b57def4053d6 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:15.292750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f365a1-2032-4e04-93fc-7f3a7ed2f06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:15.293420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f365a1-2032-4e04-93fc-7f3a7ed2f06e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.293742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f365a1-2032-4e04-93fc-7f3a7ed2f06e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.294021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f365a1-2032-4e04-93fc-7f3a7ed2f06e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.294925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f365a1-2032-4e04-93fc-7f3a7ed2f06e None admin] RBAC: Adding query filter params (role.id=e3e665bc6a4749e99c8ae8d00deafb3a, scope.project.id=e516b1510c304deca52090a8334ae8fd, user.id=851ddf2e4d904421876928dbfdf30361) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:15.295244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f365a1-2032-4e04-93fc-7f3a7ed2f06e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:15.296711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f365a1-2032-4e04-93fc-7f3a7ed2f06e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:15.301369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:15.303448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 57/115] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:15 2022] GET /identity/v3/role_assignments?user.id=851ddf2e4d904421876928dbfdf30361&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=e3e665bc6a4749e99c8ae8d00deafb3a => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:15.304770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baa2fb-abfa-458c-92be-c247c5bab9de None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.305060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baa2fb-abfa-458c-92be-c247c5bab9de None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.305342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86baa2fb-abfa-458c-92be-c247c5bab9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.352063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-86baa2fb-abfa-458c-92be-c247c5bab9de None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:15.355870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-86baa2fb-abfa-458c-92be-c247c5bab9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:15.400824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434580cb-be58-4b58-999d-554450085834 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:15.488927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957618e-6770-418d-bdab-0e3186bbd714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:15.489943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957618e-6770-418d-bdab-0e3186bbd714 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.490233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957618e-6770-418d-bdab-0e3186bbd714 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.490644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957618e-6770-418d-bdab-0e3186bbd714 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.491736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 58/116] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:15.491916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957618e-6770-418d-bdab-0e3186bbd714 None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:15.493217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dc713-08de-42ec-b41d-a789f62597a0 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.493550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957618e-6770-418d-bdab-0e3186bbd714 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:15.493652 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dc713-08de-42ec-b41d-a789f62597a0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.494048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33dc713-08de-42ec-b41d-a789f62597a0 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.495599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 59/117] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:15.496242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 59/118] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:15 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:15.501578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957618e-6770-418d-bdab-0e3186bbd714 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:15.501755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0682-9951-4560-b94a-09d3984e6d32 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.501948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0682-9951-4560-b94a-09d3984e6d32 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.502403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad0682-9951-4560-b94a-09d3984e6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.547683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-cbad0682-9951-4560-b94a-09d3984e6d32 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:15.548919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-cbad0682-9951-4560-b94a-09d3984e6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:15.558285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:15.675315 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 60/119] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:15.676065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad0682-9951-4560-b94a-09d3984e6d32 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:15.726112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957618e-6770-418d-bdab-0e3186bbd714 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:15.779544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:15.786112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598431da-c34a-45b3-901f-95ad7f9440ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:15.787222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598431da-c34a-45b3-901f-95ad7f9440ea None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.787843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598431da-c34a-45b3-901f-95ad7f9440ea None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.788133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598431da-c34a-45b3-901f-95ad7f9440ea None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd/users/ec4709eda5dd45ea8a9d35bf7da1f22b/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.790218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598431da-c34a-45b3-901f-95ad7f9440ea None admin] RBAC: Authorizing `identity:create_grant(project_id=e516b1510c304deca52090a8334ae8fd, user_id=ec4709eda5dd45ea8a9d35bf7da1f22b, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:15.792594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598431da-c34a-45b3-901f-95ad7f9440ea None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:15.809055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad0682-9951-4560-b94a-09d3984e6d32 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:15.810121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 60/120] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:36:15 2022] PUT /identity/v3/projects/e516b1510c304deca52090a8334ae8fd/users/ec4709eda5dd45ea8a9d35bf7da1f22b/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:15.812009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148f54-376f-448e-8124-596d3c708ccc None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.812318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148f54-376f-448e-8124-596d3c708ccc None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.812655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148f54-376f-448e-8124-596d3c708ccc None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.814135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 61/121] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:15.815338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148f54-376f-448e-8124-596d3c708ccc None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:15.927781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104d54b-9ad4-4f1d-9abc-07fedd0c6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:15.928789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104d54b-9ad4-4f1d-9abc-07fedd0c6b38 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.929077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104d54b-9ad4-4f1d-9abc-07fedd0c6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.929357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104d54b-9ad4-4f1d-9abc-07fedd0c6b38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.945470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:15.950504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148f54-376f-448e-8124-596d3c708ccc None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:15.959474 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104d54b-9ad4-4f1d-9abc-07fedd0c6b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-9104d54b-9ad4-4f1d-9abc-07fedd0c6b38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:15.976837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:15.979773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 61/122] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:15.982102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff4a10-bc63-4cb0-99c6-44c194aa8397 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.983844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff4a10-bc63-4cb0-99c6-44c194aa8397 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.983844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff4a10-bc63-4cb0-99c6-44c194aa8397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:15.991119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea73c5a-3b27-467b-9c9b-3ce7bf852fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:15.991946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea73c5a-3b27-467b-9c9b-3ce7bf852fad None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:15.992241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea73c5a-3b27-467b-9c9b-3ce7bf852fad None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:15.992525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea73c5a-3b27-467b-9c9b-3ce7bf852fad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:16.006581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea73c5a-3b27-467b-9c9b-3ce7bf852fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-aea73c5a-3b27-467b-9c9b-3ce7bf852fad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:16.019707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:16.022269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:16.024227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 62/123] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:16.030406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea73c5a-3b27-467b-9c9b-3ce7bf852fad None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:16.035471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8eff4a10-bc63-4cb0-99c6-44c194aa8397 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:16.036860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8eff4a10-bc63-4cb0-99c6-44c194aa8397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:16.101054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:16.167462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 62/124] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:16.168873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff4a10-bc63-4cb0-99c6-44c194aa8397 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:16.170282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea73c5a-3b27-467b-9c9b-3ce7bf852fad None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:16.215158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fe4c3-6873-41fb-b02e-8b61bb37870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:16.215848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fe4c3-6873-41fb-b02e-8b61bb37870c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:16.216140 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fe4c3-6873-41fb-b02e-8b61bb37870c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:16.216426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fe4c3-6873-41fb-b02e-8b61bb37870c None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:16.217198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fe4c3-6873-41fb-b02e-8b61bb37870c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:16.217514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fe4c3-6873-41fb-b02e-8b61bb37870c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:16.218962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fe4c3-6873-41fb-b02e-8b61bb37870c None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:16.228151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 63/125] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:16.228941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fe4c3-6873-41fb-b02e-8b61bb37870c None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:16.338093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fe4c3-6873-41fb-b02e-8b61bb37870c None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:16.355534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:16.377169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f424d3-bf52-4654-8b13-b46146c9ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:16.377990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f424d3-bf52-4654-8b13-b46146c9ddcb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:16.378281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f424d3-bf52-4654-8b13-b46146c9ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:16.378596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f424d3-bf52-4654-8b13-b46146c9ddcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:16.392595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f424d3-bf52-4654-8b13-b46146c9ddcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-75f424d3-bf52-4654-8b13-b46146c9ddcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:16.404201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:16.406838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 64/126] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:16.408765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f424d3-bf52-4654-8b13-b46146c9ddcb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:16.444379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff4a10-bc63-4cb0-99c6-44c194aa8397 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:16.523566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f424d3-bf52-4654-8b13-b46146c9ddcb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:16.537191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:16.557648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c115890-945b-4f82-bf2d-6b90237ff66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:16.558679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c115890-945b-4f82-bf2d-6b90237ff66f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:16.559239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c115890-945b-4f82-bf2d-6b90237ff66f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:16.559720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c115890-945b-4f82-bf2d-6b90237ff66f None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:16.560876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c115890-945b-4f82-bf2d-6b90237ff66f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:16.561382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c115890-945b-4f82-bf2d-6b90237ff66f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:16.568497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c115890-945b-4f82-bf2d-6b90237ff66f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:16.578115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bac7b-1523-4f19-b26c-751aa931594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:16.579036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bac7b-1523-4f19-b26c-751aa931594d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:16.579332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bac7b-1523-4f19-b26c-751aa931594d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:16.579626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bac7b-1523-4f19-b26c-751aa931594d None admin] PATH_INFO: `/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:16.580905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bac7b-1523-4f19-b26c-751aa931594d None admin] RBAC: Authorizing `identity:get_user(user_id=ec4709eda5dd45ea8a9d35bf7da1f22b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:16.582437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bac7b-1523-4f19-b26c-751aa931594d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:16.584262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 65/127] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:16 2022] GET /identity/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:16.585146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bac7b-1523-4f19-b26c-751aa931594d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:16.590110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 63/128] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:16.596850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c115890-945b-4f82-bf2d-6b90237ff66f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:16.654767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:16.740118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bac7b-1523-4f19-b26c-751aa931594d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:16.751737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c115890-945b-4f82-bf2d-6b90237ff66f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:16.781380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b43459-68f7-4203-b11e-08b7a1adeea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:16.782068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43459-68f7-4203-b11e-08b7a1adeea4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:16.782379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43459-68f7-4203-b11e-08b7a1adeea4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:16.782670 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43459-68f7-4203-b11e-08b7a1adeea4 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:16.783502 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b43459-68f7-4203-b11e-08b7a1adeea4 None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:16.783821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b43459-68f7-4203-b11e-08b7a1adeea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:16.785226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b43459-68f7-4203-b11e-08b7a1adeea4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:16.797938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da9d1b-8223-4453-9e8a-a64852d3d55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:16.799044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da9d1b-8223-4453-9e8a-a64852d3d55a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:16.799399 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da9d1b-8223-4453-9e8a-a64852d3d55a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:16.802454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da9d1b-8223-4453-9e8a-a64852d3d55a None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:16.804034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da9d1b-8223-4453-9e8a-a64852d3d55a None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:16.805512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da9d1b-8223-4453-9e8a-a64852d3d55a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:16.808106 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 64/129] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:16 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:16.808723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da9d1b-8223-4453-9e8a-a64852d3d55a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:16.813635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 66/130] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:16.818647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b43459-68f7-4203-b11e-08b7a1adeea4 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:16.934840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:16.995788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b43459-68f7-4203-b11e-08b7a1adeea4 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:17.015826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:17.044592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da9d1b-8223-4453-9e8a-a64852d3d55a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:17.049525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5982be-c398-4ff4-90ec-3c0e3df8b277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:17.049959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5982be-c398-4ff4-90ec-3c0e3df8b277 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.050250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5982be-c398-4ff4-90ec-3c0e3df8b277 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.050562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5982be-c398-4ff4-90ec-3c0e3df8b277 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd/users/ec4709eda5dd45ea8a9d35bf7da1f22b/roles/5e9864ab3b774da195d4d0b7282074ab` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.057965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5982be-c398-4ff4-90ec-3c0e3df8b277 None admin] RBAC: Authorizing `identity:create_grant(project_id=e516b1510c304deca52090a8334ae8fd, user_id=ec4709eda5dd45ea8a9d35bf7da1f22b, role_id=5e9864ab3b774da195d4d0b7282074ab)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:17.059490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5982be-c398-4ff4-90ec-3c0e3df8b277 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:17.083050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 67/131] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:36:16 2022] PUT /identity/v3/projects/e516b1510c304deca52090a8334ae8fd/users/ec4709eda5dd45ea8a9d35bf7da1f22b/roles/5e9864ab3b774da195d4d0b7282074ab => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:17.083883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5982be-c398-4ff4-90ec-3c0e3df8b277 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:17.131822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fd2df-10a7-44e0-8629-0700e1d6d075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:17.132730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fd2df-10a7-44e0-8629-0700e1d6d075 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.133021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fd2df-10a7-44e0-8629-0700e1d6d075 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.133310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fd2df-10a7-44e0-8629-0700e1d6d075 None admin] PATH_INFO: `/v3/users/a27ae7f7dcd846e6909f95c2447d5f53` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.134725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fd2df-10a7-44e0-8629-0700e1d6d075 None admin] RBAC: Authorizing `identity:get_user(user_id=a27ae7f7dcd846e6909f95c2447d5f53)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:17.136469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fd2df-10a7-44e0-8629-0700e1d6d075 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:17.138271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 65/132] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:16 2022] GET /identity/v3/users/a27ae7f7dcd846e6909f95c2447d5f53 => generated 247 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:17.155567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fd2df-10a7-44e0-8629-0700e1d6d075 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:17.321422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5982be-c398-4ff4-90ec-3c0e3df8b277 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:17.364891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa6ec-5fbb-4ac2-94d2-1f771a60c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:17.365794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa6ec-5fbb-4ac2-94d2-1f771a60c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.366085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa6ec-5fbb-4ac2-94d2-1f771a60c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.366400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa6ec-5fbb-4ac2-94d2-1f771a60c4b6 None admin] PATH_INFO: `/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.367684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaa6ec-5fbb-4ac2-94d2-1f771a60c4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4709eda5dd45ea8a9d35bf7da1f22b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:17.369827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaa6ec-5fbb-4ac2-94d2-1f771a60c4b6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:17.374345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 68/133] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:17 2022] GET /identity/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:17.377427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa6ec-5fbb-4ac2-94d2-1f771a60c4b6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:17.416453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:17.453333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fd2df-10a7-44e0-8629-0700e1d6d075 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:17.502876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa6ec-5fbb-4ac2-94d2-1f771a60c4b6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:17.523604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:17.554159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72476b53-2f3f-410c-b841-44e418754626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:17.555071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72476b53-2f3f-410c-b841-44e418754626 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.555445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72476b53-2f3f-410c-b841-44e418754626 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.555730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72476b53-2f3f-410c-b841-44e418754626 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.563295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72476b53-2f3f-410c-b841-44e418754626 None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:17.565050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72476b53-2f3f-410c-b841-44e418754626 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:17.567268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 66/134] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:17 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:17.579456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72476b53-2f3f-410c-b841-44e418754626 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:17.597642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ccb6-d4b8-483b-b066-ce83d8d6174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:17.598554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ccb6-d4b8-483b-b066-ce83d8d6174e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.598839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ccb6-d4b8-483b-b066-ce83d8d6174e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.599227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ccb6-d4b8-483b-b066-ce83d8d6174e None admin] PATH_INFO: `/v3/projects/90598103e6b947a6aa99bed64829bb5b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.600478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814ccb6-d4b8-483b-b066-ce83d8d6174e None admin] RBAC: Authorizing `identity:get_project(project_id=90598103e6b947a6aa99bed64829bb5b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:17.602022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814ccb6-d4b8-483b-b066-ce83d8d6174e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:17.610802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 69/135] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:17 2022] GET /identity/v3/projects/90598103e6b947a6aa99bed64829bb5b => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:17.617186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ccb6-d4b8-483b-b066-ce83d8d6174e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:17.840092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:17.842287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72476b53-2f3f-410c-b841-44e418754626 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:17.847235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ccb6-d4b8-483b-b066-ce83d8d6174e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:17.909976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9c7e-7b6e-4c48-b727-5d2a362fdaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:17.911254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9c7e-7b6e-4c48-b727-5d2a362fdaae None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.911766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9c7e-7b6e-4c48-b727-5d2a362fdaae None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.912241 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9c7e-7b6e-4c48-b727-5d2a362fdaae None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd/users/a27ae7f7dcd846e6909f95c2447d5f53/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.915362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9c7e-7b6e-4c48-b727-5d2a362fdaae None admin] RBAC: Authorizing `identity:create_grant(project_id=e516b1510c304deca52090a8334ae8fd, user_id=a27ae7f7dcd846e6909f95c2447d5f53, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:17.916228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc4dec-bb56-4f20-b889-0f665989fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:17.917984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9c7e-7b6e-4c48-b727-5d2a362fdaae None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:17.918799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc4dec-bb56-4f20-b889-0f665989fdf4 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.919096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc4dec-bb56-4f20-b889-0f665989fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.919384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc4dec-bb56-4f20-b889-0f665989fdf4 None admin] PATH_INFO: `/v3/projects/90598103e6b947a6aa99bed64829bb5b/users/ec4709eda5dd45ea8a9d35bf7da1f22b/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.921526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc4dec-bb56-4f20-b889-0f665989fdf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=90598103e6b947a6aa99bed64829bb5b, user_id=ec4709eda5dd45ea8a9d35bf7da1f22b, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:17.923056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc4dec-bb56-4f20-b889-0f665989fdf4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:17.936275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 67/136] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:36:17 2022] PUT /identity/v3/projects/e516b1510c304deca52090a8334ae8fd/users/a27ae7f7dcd846e6909f95c2447d5f53/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:17.938120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0fe5a-679b-4f1a-a4f1-ea9e628a64d6 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.938559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 70/137] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:36:17 2022] PUT /identity/v3/projects/90598103e6b947a6aa99bed64829bb5b/users/ec4709eda5dd45ea8a9d35bf7da1f22b/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:36:17.938880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0fe5a-679b-4f1a-a4f1-ea9e628a64d6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.939662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0fe5a-679b-4f1a-a4f1-ea9e628a64d6 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.940250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63bfc3-719b-4878-b263-ae70e74db101 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.940549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63bfc3-719b-4878-b263-ae70e74db101 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.940835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63bfc3-719b-4878-b263-ae70e74db101 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.941968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 68/138] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:17.942229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 71/139] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:17.948516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acba04b-a0ec-4ca6-b05e-94cb3db30324 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.948979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acba04b-a0ec-4ca6-b05e-94cb3db30324 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.949080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acba04b-a0ec-4ca6-b05e-94cb3db30324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.954768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7062f2c-1f29-43f3-9d23-3a31a5eb6acb None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:17.955415 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7062f2c-1f29-43f3-9d23-3a31a5eb6acb None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:17.955983 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7062f2c-1f29-43f3-9d23-3a31a5eb6acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:17.970195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8acba04b-a0ec-4ca6-b05e-94cb3db30324 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:17.971776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8acba04b-a0ec-4ca6-b05e-94cb3db30324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:17.976249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b7062f2c-1f29-43f3-9d23-3a31a5eb6acb None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:17.977911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b7062f2c-1f29-43f3-9d23-3a31a5eb6acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:18.040753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:18.067231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 69/140] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:18.097561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acba04b-a0ec-4ca6-b05e-94cb3db30324 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:18.134965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 72/141] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:18.185114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7062f2c-1f29-43f3-9d23-3a31a5eb6acb None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:18.234169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acba04b-a0ec-4ca6-b05e-94cb3db30324 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:18.278885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5b625-9606-4189-a2e8-a7ce01fe4114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:18.280118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5b625-9606-4189-a2e8-a7ce01fe4114 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:18.280405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5b625-9606-4189-a2e8-a7ce01fe4114 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:18.280964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5b625-9606-4189-a2e8-a7ce01fe4114 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:18.297746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5b625-9606-4189-a2e8-a7ce01fe4114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-38b5b625-9606-4189-a2e8-a7ce01fe4114 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:18.306490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:18.307425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:18.308221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 70/142] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:18.314047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5b625-9606-4189-a2e8-a7ce01fe4114 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:18.369908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:18.385306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7062f2c-1f29-43f3-9d23-3a31a5eb6acb None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:18.392731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:18.426352 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5b625-9606-4189-a2e8-a7ce01fe4114 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:18.439069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1304a32-81b7-4c8a-b6c2-dfc5e4be7e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:18.440809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1304a32-81b7-4c8a-b6c2-dfc5e4be7e51 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:18.441291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1304a32-81b7-4c8a-b6c2-dfc5e4be7e51 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:18.441877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1304a32-81b7-4c8a-b6c2-dfc5e4be7e51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:18.443480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1304a32-81b7-4c8a-b6c2-dfc5e4be7e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:18.445149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1304a32-81b7-4c8a-b6c2-dfc5e4be7e51 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:18.447765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 73/143] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:18.453792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1304a32-81b7-4c8a-b6c2-dfc5e4be7e51 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:18.461520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae5ba2-6879-4fdd-8bdd-f6f341dcbeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:18.462796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae5ba2-6879-4fdd-8bdd-f6f341dcbeb4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:18.463141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae5ba2-6879-4fdd-8bdd-f6f341dcbeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:18.463479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae5ba2-6879-4fdd-8bdd-f6f341dcbeb4 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:18.464248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae5ba2-6879-4fdd-8bdd-f6f341dcbeb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:18.464562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae5ba2-6879-4fdd-8bdd-f6f341dcbeb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:18.465974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae5ba2-6879-4fdd-8bdd-f6f341dcbeb4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:18.475044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 71/144] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:18.481432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae5ba2-6879-4fdd-8bdd-f6f341dcbeb4 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:18.606750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae5ba2-6879-4fdd-8bdd-f6f341dcbeb4 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:18.622794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:18.675281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832a75d-df3a-44b4-ad0e-d8b69b63a2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:18.676196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832a75d-df3a-44b4-ad0e-d8b69b63a2f7 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:18.676484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832a75d-df3a-44b4-ad0e-d8b69b63a2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:18.676766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832a75d-df3a-44b4-ad0e-d8b69b63a2f7 None admin] PATH_INFO: `/v3/users/851ddf2e4d904421876928dbfdf30361` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:18.678087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832a75d-df3a-44b4-ad0e-d8b69b63a2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=851ddf2e4d904421876928dbfdf30361)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:18.679761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832a75d-df3a-44b4-ad0e-d8b69b63a2f7 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:18.682774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 72/145] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:18 2022] GET /identity/v3/users/851ddf2e4d904421876928dbfdf30361 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:18.688223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832a75d-df3a-44b4-ad0e-d8b69b63a2f7 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:18.688914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1304a32-81b7-4c8a-b6c2-dfc5e4be7e51 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:18.780450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6457c07-6b72-4042-9ec8-edb14e3369e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:18.781230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6457c07-6b72-4042-9ec8-edb14e3369e3 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:18.781525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6457c07-6b72-4042-9ec8-edb14e3369e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:18.781813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6457c07-6b72-4042-9ec8-edb14e3369e3 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:18.782591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6457c07-6b72-4042-9ec8-edb14e3369e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:18.784292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6457c07-6b72-4042-9ec8-edb14e3369e3 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:18.799174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832a75d-df3a-44b4-ad0e-d8b69b63a2f7 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:18.841492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71761f5-f4c5-43c3-a962-3507847ec2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:18.842389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71761f5-f4c5-43c3-a962-3507847ec2dc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:18.842717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71761f5-f4c5-43c3-a962-3507847ec2dc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:18.843087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71761f5-f4c5-43c3-a962-3507847ec2dc None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:18.846435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 74/146] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:36:18 2022] POST /identity/v3/users => generated 283 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:36:18.850952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71761f5-f4c5-43c3-a962-3507847ec2dc None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:18.852607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71761f5-f4c5-43c3-a962-3507847ec2dc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:18.855257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 73/147] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:18 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:18.863396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6457c07-6b72-4042-9ec8-edb14e3369e3 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:18.892438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:19.019737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6457c07-6b72-4042-9ec8-edb14e3369e3 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:19.071610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14621c28-b22c-45aa-b099-a426ab2b81ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:19.072525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621c28-b22c-45aa-b099-a426ab2b81ac None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:19.072808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621c28-b22c-45aa-b099-a426ab2b81ac None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:19.073090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621c28-b22c-45aa-b099-a426ab2b81ac None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd/users/851ddf2e4d904421876928dbfdf30361/roles/e3e665bc6a4749e99c8ae8d00deafb3a` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:19.079756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14621c28-b22c-45aa-b099-a426ab2b81ac None admin] RBAC: Authorizing `identity:create_grant(project_id=e516b1510c304deca52090a8334ae8fd, user_id=851ddf2e4d904421876928dbfdf30361, role_id=e3e665bc6a4749e99c8ae8d00deafb3a)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:19.081242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14621c28-b22c-45aa-b099-a426ab2b81ac None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:19.103926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 75/148] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:36:18 2022] PUT /identity/v3/projects/e516b1510c304deca52090a8334ae8fd/users/851ddf2e4d904421876928dbfdf30361/roles/e3e665bc6a4749e99c8ae8d00deafb3a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:19.329718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18544a-8391-4ef4-8b64-21d97521527f None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:19.329718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18544a-8391-4ef4-8b64-21d97521527f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:19.329718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18544a-8391-4ef4-8b64-21d97521527f None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:19.329718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 74/149] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:19.335737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd45a7-8643-4638-95fa-045387d26a0c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:19.336066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd45a7-8643-4638-95fa-045387d26a0c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:19.336314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd45a7-8643-4638-95fa-045387d26a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:19.360150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-12bd45a7-8643-4638-95fa-045387d26a0c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:19.361455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-12bd45a7-8643-4638-95fa-045387d26a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:19.451147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 76/150] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:19.495089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18544a-8391-4ef4-8b64-21d97521527f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:19.550460 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:19.616051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18544a-8391-4ef4-8b64-21d97521527f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:19.654754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bce221-b88d-4893-8720-4d129f7f61c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:19.655554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce221-b88d-4893-8720-4d129f7f61c8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:19.655836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce221-b88d-4893-8720-4d129f7f61c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:19.656112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce221-b88d-4893-8720-4d129f7f61c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:19.668272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bce221-b88d-4893-8720-4d129f7f61c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-78bce221-b88d-4893-8720-4d129f7f61c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:19.676218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:19.677156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:19.678016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 75/151] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:19.685930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd45a7-8643-4638-95fa-045387d26a0c None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:19.692086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:19.832509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd45a7-8643-4638-95fa-045387d26a0c None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:19.883625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbf727-4419-4528-9944-1506176cc3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:19.885243 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbf727-4419-4528-9944-1506176cc3c0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:19.885539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbf727-4419-4528-9944-1506176cc3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:19.885820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbf727-4419-4528-9944-1506176cc3c0 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:19.886630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbf727-4419-4528-9944-1506176cc3c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:19.886944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbf727-4419-4528-9944-1506176cc3c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:19.888377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbf727-4419-4528-9944-1506176cc3c0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:19.902933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 77/152] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:19.908632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bce221-b88d-4893-8720-4d129f7f61c8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:20.044264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bce221-b88d-4893-8720-4d129f7f61c8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:20.045940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:20.081434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ebe38-b25b-46dc-bcc3-397b46345618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:20.082310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ebe38-b25b-46dc-bcc3-397b46345618 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:20.082611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ebe38-b25b-46dc-bcc3-397b46345618 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:20.082890 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ebe38-b25b-46dc-bcc3-397b46345618 None admin] PATH_INFO: `/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:20.084124 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ebe38-b25b-46dc-bcc3-397b46345618 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4709eda5dd45ea8a9d35bf7da1f22b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:20.085608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ebe38-b25b-46dc-bcc3-397b46345618 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:20.088450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 76/153] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:19 2022] GET /identity/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:20.095805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbf727-4419-4528-9944-1506176cc3c0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:20.197783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:20.239742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbf727-4419-4528-9944-1506176cc3c0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:20.248369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b4475-51d9-49f2-a8ed-dd257efa1a5c None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:20.248970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b4475-51d9-49f2-a8ed-dd257efa1a5c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:20.249463 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b4475-51d9-49f2-a8ed-dd257efa1a5c None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:20.251361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 77/154] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:20.256548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdecb9-415b-4f8a-ad52-e27db3f254f4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:20.257183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdecb9-415b-4f8a-ad52-e27db3f254f4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:20.257672 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdecb9-415b-4f8a-ad52-e27db3f254f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:20.284495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0b8f5-479f-4376-a548-c20ce7ef12a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:20.285156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b8f5-479f-4376-a548-c20ce7ef12a4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:20.285448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b8f5-479f-4376-a548-c20ce7ef12a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:20.285709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0b8f5-479f-4376-a548-c20ce7ef12a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:20.292434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e0bdecb9-415b-4f8a-ad52-e27db3f254f4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:20.293649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e0bdecb9-415b-4f8a-ad52-e27db3f254f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:20.377717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0b8f5-479f-4376-a548-c20ce7ef12a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:20.379208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0b8f5-479f-4376-a548-c20ce7ef12a4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:20.456132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:20.487895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 78/155] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:20.502653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 78/156] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:20.506178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdecb9-415b-4f8a-ad52-e27db3f254f4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:20.544262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0b8f5-479f-4376-a548-c20ce7ef12a4 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:20.714340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0b8f5-479f-4376-a548-c20ce7ef12a4 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:20.727386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:20.736367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdecb9-415b-4f8a-ad52-e27db3f254f4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:20.758253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6be617-5faa-4e8c-8db2-57c69fe467d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:20.759334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6be617-5faa-4e8c-8db2-57c69fe467d2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:20.760099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6be617-5faa-4e8c-8db2-57c69fe467d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:20.760389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6be617-5faa-4e8c-8db2-57c69fe467d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:20.772145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6be617-5faa-4e8c-8db2-57c69fe467d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-7c6be617-5faa-4e8c-8db2-57c69fe467d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:20.780601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:20.781692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:20.782509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 79/157] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:20.787482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6be617-5faa-4e8c-8db2-57c69fe467d2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:20.829506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:20.839160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453494-935b-41e5-ae0c-cbc1cfc578da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:20.840047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453494-935b-41e5-ae0c-cbc1cfc578da None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:20.840334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453494-935b-41e5-ae0c-cbc1cfc578da None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:20.840611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26453494-935b-41e5-ae0c-cbc1cfc578da None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:20.845386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453494-935b-41e5-ae0c-cbc1cfc578da None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:20.847028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26453494-935b-41e5-ae0c-cbc1cfc578da None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:20.849102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 79/158] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:20 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:20.869176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453494-935b-41e5-ae0c-cbc1cfc578da None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:20.916178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6be617-5faa-4e8c-8db2-57c69fe467d2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:20.953971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9648bc-9855-4f35-a410-0ecda0502a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:20.954768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9648bc-9855-4f35-a410-0ecda0502a1a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:20.955060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9648bc-9855-4f35-a410-0ecda0502a1a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:20.955437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9648bc-9855-4f35-a410-0ecda0502a1a None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:20.956198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9648bc-9855-4f35-a410-0ecda0502a1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:20.956508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9648bc-9855-4f35-a410-0ecda0502a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:20.958011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9648bc-9855-4f35-a410-0ecda0502a1a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:20.967250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 80/159] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:20.972867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9648bc-9855-4f35-a410-0ecda0502a1a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:21.011692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26453494-935b-41e5-ae0c-cbc1cfc578da None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:21.058557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf4283-a755-46cf-ae0e-b0c6057e2b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:21.059274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf4283-a755-46cf-ae0e-b0c6057e2b10 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:21.059610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf4283-a755-46cf-ae0e-b0c6057e2b10 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:21.059892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf4283-a755-46cf-ae0e-b0c6057e2b10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:21.060742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf4283-a755-46cf-ae0e-b0c6057e2b10 None admin] RBAC: Adding query filter params (role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=e516b1510c304deca52090a8334ae8fd, user.id=ec4709eda5dd45ea8a9d35bf7da1f22b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:21.061053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf4283-a755-46cf-ae0e-b0c6057e2b10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:21.062566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf4283-a755-46cf-ae0e-b0c6057e2b10 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:21.073716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 80/160] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:20 2022] GET /identity/v3/role_assignments?user.id=ec4709eda5dd45ea8a9d35bf7da1f22b&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:21.130791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:21.138707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9648bc-9855-4f35-a410-0ecda0502a1a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:21.197658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385686d-66d0-44b5-9f23-562bd8b34c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:21.198593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385686d-66d0-44b5-9f23-562bd8b34c22 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:21.198877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385686d-66d0-44b5-9f23-562bd8b34c22 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:21.199151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385686d-66d0-44b5-9f23-562bd8b34c22 None admin] PATH_INFO: `/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:21.203233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385686d-66d0-44b5-9f23-562bd8b34c22 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4709eda5dd45ea8a9d35bf7da1f22b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:21.204737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385686d-66d0-44b5-9f23-562bd8b34c22 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:21.207171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 81/161] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:20 2022] GET /identity/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:21.214605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf4283-a755-46cf-ae0e-b0c6057e2b10 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:21.275572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:21.367918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf4283-a755-46cf-ae0e-b0c6057e2b10 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:21.413921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb61fe-8302-4d8e-b03c-7ec51b8b1694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:21.414682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb61fe-8302-4d8e-b03c-7ec51b8b1694 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:21.414972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb61fe-8302-4d8e-b03c-7ec51b8b1694 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:21.415774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb61fe-8302-4d8e-b03c-7ec51b8b1694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:21.503075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb61fe-8302-4d8e-b03c-7ec51b8b1694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:21.504620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb61fe-8302-4d8e-b03c-7ec51b8b1694 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:21.554700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:21.626856 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 81/162] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:21.632477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385686d-66d0-44b5-9f23-562bd8b34c22 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:21.757551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385686d-66d0-44b5-9f23-562bd8b34c22 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:21.800069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed1a62-b456-4b9e-a042-43f9de75d3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:21.801294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed1a62-b456-4b9e-a042-43f9de75d3c0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:21.801771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed1a62-b456-4b9e-a042-43f9de75d3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:21.802237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed1a62-b456-4b9e-a042-43f9de75d3c0 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:21.803746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed1a62-b456-4b9e-a042-43f9de75d3c0 None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:21.805438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed1a62-b456-4b9e-a042-43f9de75d3c0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:21.808258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 82/163] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:21 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:21.813907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb61fe-8302-4d8e-b03c-7ec51b8b1694 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:21.959854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb61fe-8302-4d8e-b03c-7ec51b8b1694 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:22.001791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:22.007230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42096b-47a0-486c-96cc-5047cb23d2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:22.007767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42096b-47a0-486c-96cc-5047cb23d2f2 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:22.008019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42096b-47a0-486c-96cc-5047cb23d2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:22.008625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42096b-47a0-486c-96cc-5047cb23d2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:22.010080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42096b-47a0-486c-96cc-5047cb23d2f2 None admin] RBAC: Adding query filter params (role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=e516b1510c304deca52090a8334ae8fd, user.id=ec4709eda5dd45ea8a9d35bf7da1f22b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:22.010838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42096b-47a0-486c-96cc-5047cb23d2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:22.012804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42096b-47a0-486c-96cc-5047cb23d2f2 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:22.020154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 82/164] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:21 2022] GET /identity/v3/role_assignments?user.id=ec4709eda5dd45ea8a9d35bf7da1f22b&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:22.122828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05622a55-4bc6-4e06-8834-b69ebfaa050f None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:22.123631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05622a55-4bc6-4e06-8834-b69ebfaa050f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:22.124318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05622a55-4bc6-4e06-8834-b69ebfaa050f None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:22.127307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 83/165] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:22.135066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b4b5-c18a-4f65-9ef4-0aa2adef1df7 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:22.135462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b4b5-c18a-4f65-9ef4-0aa2adef1df7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:22.135668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77b4b5-c18a-4f65-9ef4-0aa2adef1df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:22.158276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa90e9c-9e23-4cd9-89c2-3e82f7fbb090 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:22.159158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa90e9c-9e23-4cd9-89c2-3e82f7fbb090 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:22.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-9a77b4b5-c18a-4f65-9ef4-0aa2adef1df7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:22.160096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa90e9c-9e23-4cd9-89c2-3e82f7fbb090 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:22.160736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9a77b4b5-c18a-4f65-9ef4-0aa2adef1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:22.163305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 84/166] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:22.169885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fe7bf-05da-443f-90ad-b97146387221 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:22.170784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fe7bf-05da-443f-90ad-b97146387221 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:22.171518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fe7bf-05da-443f-90ad-b97146387221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:22.224010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f03fe7bf-05da-443f-90ad-b97146387221 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:22.226355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f03fe7bf-05da-443f-90ad-b97146387221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:22.269300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 83/167] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:22.286819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:22.356586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b4b5-c18a-4f65-9ef4-0aa2adef1df7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:22.389130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 85/168] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:22.429201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fe7bf-05da-443f-90ad-b97146387221 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:22.471051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77b4b5-c18a-4f65-9ef4-0aa2adef1df7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:22.501266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:22.531675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f0fa7-4bb6-49cf-a641-f2d8405de62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:22.533139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f0fa7-4bb6-49cf-a641-f2d8405de62a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:22.533139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f0fa7-4bb6-49cf-a641-f2d8405de62a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:22.533139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f0fa7-4bb6-49cf-a641-f2d8405de62a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:22.558050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f0fa7-4bb6-49cf-a641-f2d8405de62a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-3f7f0fa7-4bb6-49cf-a641-f2d8405de62a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:22.566141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:22.567283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:22.568112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:22.570672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fe7bf-05da-443f-90ad-b97146387221 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:22.571635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 84/169] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:22.582839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f0fa7-4bb6-49cf-a641-f2d8405de62a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:22.611386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817d589-902f-4df1-b737-91df2fb1a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:22.612477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d589-902f-4df1-b737-91df2fb1a419 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:22.612907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d589-902f-4df1-b737-91df2fb1a419 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:22.613327 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817d589-902f-4df1-b737-91df2fb1a419 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:22.625753 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817d589-902f-4df1-b737-91df2fb1a419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-8817d589-902f-4df1-b737-91df2fb1a419 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:22.635155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:22.636802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:22.637869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:22.640085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 86/170] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:22.646545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817d589-902f-4df1-b737-91df2fb1a419 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:22.690794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:22.718346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f0fa7-4bb6-49cf-a641-f2d8405de62a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:22.774342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedee2ce-fbce-4b69-914f-71db919a8499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:22.774342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedee2ce-fbce-4b69-914f-71db919a8499 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:22.774342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedee2ce-fbce-4b69-914f-71db919a8499 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:22.774342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedee2ce-fbce-4b69-914f-71db919a8499 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:22.774811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedee2ce-fbce-4b69-914f-71db919a8499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:22.775020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedee2ce-fbce-4b69-914f-71db919a8499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:22.776501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedee2ce-fbce-4b69-914f-71db919a8499 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:22.796330 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 85/171] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:22.801977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedee2ce-fbce-4b69-914f-71db919a8499 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:22.832801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817d589-902f-4df1-b737-91df2fb1a419 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:22.869705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:22.903160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992d3e0-2839-44de-af96-569eb5050c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:22.904092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992d3e0-2839-44de-af96-569eb5050c37 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:22.904525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992d3e0-2839-44de-af96-569eb5050c37 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:22.904952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992d3e0-2839-44de-af96-569eb5050c37 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:22.905869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992d3e0-2839-44de-af96-569eb5050c37 None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:22.906441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992d3e0-2839-44de-af96-569eb5050c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:22.908010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992d3e0-2839-44de-af96-569eb5050c37 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:22.921830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 87/172] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:22.935379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992d3e0-2839-44de-af96-569eb5050c37 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:22.944746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedee2ce-fbce-4b69-914f-71db919a8499 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:23.007657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89b087-a3f5-4416-8a31-3531b21ae8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:23.008779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89b087-a3f5-4416-8a31-3531b21ae8eb None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.009778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89b087-a3f5-4416-8a31-3531b21ae8eb None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.010233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89b087-a3f5-4416-8a31-3531b21ae8eb None admin] PATH_INFO: `/v3/users/a27ae7f7dcd846e6909f95c2447d5f53` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.020358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89b087-a3f5-4416-8a31-3531b21ae8eb None admin] RBAC: Authorizing `identity:get_user(user_id=a27ae7f7dcd846e6909f95c2447d5f53)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:23.021899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89b087-a3f5-4416-8a31-3531b21ae8eb None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:23.031328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 86/173] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:22 2022] GET /identity/v3/users/a27ae7f7dcd846e6909f95c2447d5f53 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:23.034356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89b087-a3f5-4416-8a31-3531b21ae8eb None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:23.129665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:23.180362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992d3e0-2839-44de-af96-569eb5050c37 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:23.259898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f09c2-0674-4c47-ba74-fd48dd6a6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:23.260797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f09c2-0674-4c47-ba74-fd48dd6a6131 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.261080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f09c2-0674-4c47-ba74-fd48dd6a6131 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.261357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f09c2-0674-4c47-ba74-fd48dd6a6131 None admin] PATH_INFO: `/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.264099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89b087-a3f5-4416-8a31-3531b21ae8eb None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:23.265703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f09c2-0674-4c47-ba74-fd48dd6a6131 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4709eda5dd45ea8a9d35bf7da1f22b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:23.267275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f09c2-0674-4c47-ba74-fd48dd6a6131 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:23.272088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 88/174] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:22 2022] GET /identity/v3/users/ec4709eda5dd45ea8a9d35bf7da1f22b => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:23.277906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f09c2-0674-4c47-ba74-fd48dd6a6131 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:23.301905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:23.349833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e2193-965d-4370-843c-825e0599b4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:23.350519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2193-965d-4370-843c-825e0599b4fc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.350807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2193-965d-4370-843c-825e0599b4fc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.351087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2193-965d-4370-843c-825e0599b4fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.489698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f09c2-0674-4c47-ba74-fd48dd6a6131 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:23.498180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e2193-965d-4370-843c-825e0599b4fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:23.500511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e2193-965d-4370-843c-825e0599b4fc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:23.546877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f395fc7-d83f-49f9-8116-5b7bf1cfb4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:23.547869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395fc7-d83f-49f9-8116-5b7bf1cfb4e8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.548460 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395fc7-d83f-49f9-8116-5b7bf1cfb4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.548951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395fc7-d83f-49f9-8116-5b7bf1cfb4e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.566806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:23.630885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f395fc7-d83f-49f9-8116-5b7bf1cfb4e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:23.633004 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f395fc7-d83f-49f9-8116-5b7bf1cfb4e8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:23.638242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 87/175] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:23.639708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc373ff3-a045-4b52-bdb0-2c1083e94461 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.640170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc373ff3-a045-4b52-bdb0-2c1083e94461 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.640599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc373ff3-a045-4b52-bdb0-2c1083e94461 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.642079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 88/176] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:23.643508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0811097-3963-4af5-86eb-ee1426985d9c None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.643984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0811097-3963-4af5-86eb-ee1426985d9c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.644439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0811097-3963-4af5-86eb-ee1426985d9c None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.645878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 89/177] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:23.652689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfc5d5-6b1a-42e1-9d2c-47b81ccb72a5 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.653366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfc5d5-6b1a-42e1-9d2c-47b81ccb72a5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.653981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfc5d5-6b1a-42e1-9d2c-47b81ccb72a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.673869 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d9cfc5d5-6b1a-42e1-9d2c-47b81ccb72a5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:23.675404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d9cfc5d5-6b1a-42e1-9d2c-47b81ccb72a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:23.688585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:23.754183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 90/178] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:23.756031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfc5d5-6b1a-42e1-9d2c-47b81ccb72a5 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:23.763314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 89/179] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:36:23.765183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474432f9-4915-4791-a662-471da72c323b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.765660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474432f9-4915-4791-a662-471da72c323b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.766114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474432f9-4915-4791-a662-471da72c323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.783545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-474432f9-4915-4791-a662-471da72c323b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:23.785071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-474432f9-4915-4791-a662-471da72c323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:23.836697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:23.872982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 90/180] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:23.874940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bcd22-346d-4659-8ae3-6f8e9b528d32 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.875364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bcd22-346d-4659-8ae3-6f8e9b528d32 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.875809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bcd22-346d-4659-8ae3-6f8e9b528d32 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.877460 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 91/181] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:23.878310 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bcd22-346d-4659-8ae3-6f8e9b528d32 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:23.897596 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfc5d5-6b1a-42e1-9d2c-47b81ccb72a5 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:23.934786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495526-f063-452b-9f5d-561850af85ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:23.935657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495526-f063-452b-9f5d-561850af85ae None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:23.935937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495526-f063-452b-9f5d-561850af85ae None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:23.936210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b495526-f063-452b-9f5d-561850af85ae None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:23.937436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495526-f063-452b-9f5d-561850af85ae None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:23.938964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b495526-f063-452b-9f5d-561850af85ae None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:23.940980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 91/182] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:23 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:23.941786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495526-f063-452b-9f5d-561850af85ae None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:23.958796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:24.005211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bcd22-346d-4659-8ae3-6f8e9b528d32 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.049303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b495526-f063-452b-9f5d-561850af85ae None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.052362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7b550-89cd-490f-91a5-90a5957d69aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.053226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7b550-89cd-490f-91a5-90a5957d69aa None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.053510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7b550-89cd-490f-91a5-90a5957d69aa None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.053778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7b550-89cd-490f-91a5-90a5957d69aa None admin] PATH_INFO: `/v3/projects/90598103e6b947a6aa99bed64829bb5b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.055031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7b550-89cd-490f-91a5-90a5957d69aa None admin] RBAC: Authorizing `identity:get_project(project_id=90598103e6b947a6aa99bed64829bb5b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:24.056522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7b550-89cd-490f-91a5-90a5957d69aa None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:24.058436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 92/183] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:23 2022] GET /identity/v3/projects/90598103e6b947a6aa99bed64829bb5b => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:24.059447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca49364-ba5d-4172-8f52-3ba44e2faa1b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.059737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca49364-ba5d-4172-8f52-3ba44e2faa1b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.060019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca49364-ba5d-4172-8f52-3ba44e2faa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.078988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0ca49364-ba5d-4172-8f52-3ba44e2faa1b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:24.080198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0ca49364-ba5d-4172-8f52-3ba44e2faa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:24.094706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6304e-e8f5-4a55-86b8-48075768683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.095619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6304e-e8f5-4a55-86b8-48075768683b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.095998 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6304e-e8f5-4a55-86b8-48075768683b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.096271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6304e-e8f5-4a55-86b8-48075768683b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.109661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6304e-e8f5-4a55-86b8-48075768683b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-22b6304e-e8f5-4a55-86b8-48075768683b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:24.117391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:24.118381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:24.119370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:24.121719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:24.123706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 92/184] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:24.124711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6304e-e8f5-4a55-86b8-48075768683b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.157747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 93/185] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:24.158447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca49364-ba5d-4172-8f52-3ba44e2faa1b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.224410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:24.253716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6304e-e8f5-4a55-86b8-48075768683b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.276021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca49364-ba5d-4172-8f52-3ba44e2faa1b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.298598 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fc8d-8296-49e0-97c2-98505c179e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.299438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fc8d-8296-49e0-97c2-98505c179e0d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.299720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fc8d-8296-49e0-97c2-98505c179e0d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.300055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488fc8d-8296-49e0-97c2-98505c179e0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.312675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488fc8d-8296-49e0-97c2-98505c179e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:24.319881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeb0b2-7fbe-4c3b-8a2a-f0f3ead438ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.320538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeb0b2-7fbe-4c3b-8a2a-f0f3ead438ae None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.320814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeb0b2-7fbe-4c3b-8a2a-f0f3ead438ae None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-5488fc8d-8296-49e0-97c2-98505c179e0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:24.320930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:24.321810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:24.327847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:24.328458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeb0b2-7fbe-4c3b-8a2a-f0f3ead438ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.328530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 93/186] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:24.328595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeb0b2-7fbe-4c3b-8a2a-f0f3ead438ae None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=e516b1510c304deca52090a8334ae8fd, user.id=a27ae7f7dcd846e6909f95c2447d5f53) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:24.328595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeb0b2-7fbe-4c3b-8a2a-f0f3ead438ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:24.328724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fc8d-8296-49e0-97c2-98505c179e0d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.328790 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceeb0b2-7fbe-4c3b-8a2a-f0f3ead438ae None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:24.334805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 94/187] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/role_assignments?user.id=a27ae7f7dcd846e6909f95c2447d5f53&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:24.340912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeb0b2-7fbe-4c3b-8a2a-f0f3ead438ae None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.382130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:24.443115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488fc8d-8296-49e0-97c2-98505c179e0d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.466452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceeb0b2-7fbe-4c3b-8a2a-f0f3ead438ae None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.479443 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918df0d2-5f5f-490d-bb01-6adaaf34d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.480864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df0d2-5f5f-490d-bb01-6adaaf34d736 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.481394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df0d2-5f5f-490d-bb01-6adaaf34d736 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.481689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df0d2-5f5f-490d-bb01-6adaaf34d736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.482570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918df0d2-5f5f-490d-bb01-6adaaf34d736 None admin] RBAC: Adding query filter params (role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=90598103e6b947a6aa99bed64829bb5b, user.id=ec4709eda5dd45ea8a9d35bf7da1f22b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:24.483051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918df0d2-5f5f-490d-bb01-6adaaf34d736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:24.484926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918df0d2-5f5f-490d-bb01-6adaaf34d736 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:24.487043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:24.494374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 94/188] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/role_assignments?user.id=ec4709eda5dd45ea8a9d35bf7da1f22b&scope.project.id=90598103e6b947a6aa99bed64829bb5b&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:24.495219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918df0d2-5f5f-490d-bb01-6adaaf34d736 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.507490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e909f92-a6d9-4102-89b9-69821900d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.508201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e909f92-a6d9-4102-89b9-69821900d203 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.508487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e909f92-a6d9-4102-89b9-69821900d203 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.508766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e909f92-a6d9-4102-89b9-69821900d203 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.510106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e909f92-a6d9-4102-89b9-69821900d203 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:24.514350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e909f92-a6d9-4102-89b9-69821900d203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:24.514350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e909f92-a6d9-4102-89b9-69821900d203 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:24.526554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 95/189] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:24.532649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e909f92-a6d9-4102-89b9-69821900d203 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.634883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918df0d2-5f5f-490d-bb01-6adaaf34d736 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.661330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:24.667064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e909f92-a6d9-4102-89b9-69821900d203 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.675670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a9d5b-5a4d-42ef-9e1e-f223c026271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.676930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a9d5b-5a4d-42ef-9e1e-f223c026271b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.677222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a9d5b-5a4d-42ef-9e1e-f223c026271b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.677510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a9d5b-5a4d-42ef-9e1e-f223c026271b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.690564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a9d5b-5a4d-42ef-9e1e-f223c026271b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-362a9d5b-5a4d-42ef-9e1e-f223c026271b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:24.699567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:24.700464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:24.701295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 95/190] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:24.702930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e45258-a71c-4cae-97fa-8b36de70d369 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.702930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e45258-a71c-4cae-97fa-8b36de70d369 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.703100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e45258-a71c-4cae-97fa-8b36de70d369 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.704316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 96/191] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:24.705089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e45258-a71c-4cae-97fa-8b36de70d369 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.710741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fa3e8-766b-47db-bd5c-c26f9ccc77c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.711477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fa3e8-766b-47db-bd5c-c26f9ccc77c2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.711765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fa3e8-766b-47db-bd5c-c26f9ccc77c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.712130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fa3e8-766b-47db-bd5c-c26f9ccc77c2 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.713011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fa3e8-766b-47db-bd5c-c26f9ccc77c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:24.713325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fa3e8-766b-47db-bd5c-c26f9ccc77c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:24.715277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fa3e8-766b-47db-bd5c-c26f9ccc77c2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:24.724341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 96/192] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:24.725157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fa3e8-766b-47db-bd5c-c26f9ccc77c2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.774072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:24.823009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e45258-a71c-4cae-97fa-8b36de70d369 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.831260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fa3e8-766b-47db-bd5c-c26f9ccc77c2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:24.855676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e99a4-eac8-4ad2-a26b-90042dcd85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.856538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e99a4-eac8-4ad2-a26b-90042dcd85a5 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.856819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e99a4-eac8-4ad2-a26b-90042dcd85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.857093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e99a4-eac8-4ad2-a26b-90042dcd85a5 None admin] PATH_INFO: `/v3/users/851ddf2e4d904421876928dbfdf30361` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.858275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e99a4-eac8-4ad2-a26b-90042dcd85a5 None admin] RBAC: Authorizing `identity:get_user(user_id=851ddf2e4d904421876928dbfdf30361)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:24.859738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e99a4-eac8-4ad2-a26b-90042dcd85a5 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:24.861368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 97/193] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/users/851ddf2e4d904421876928dbfdf30361 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:24.862519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84279434-c7aa-415e-848a-005b3b17e0e9 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.862802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84279434-c7aa-415e-848a-005b3b17e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.863080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84279434-c7aa-415e-848a-005b3b17e0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.864829 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e7758-3f05-4bba-9eb9-28f80ae40b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:24.865494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e7758-3f05-4bba-9eb9-28f80ae40b64 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:24.865957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e7758-3f05-4bba-9eb9-28f80ae40b64 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:24.866054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e7758-3f05-4bba-9eb9-28f80ae40b64 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:24.866832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e7758-3f05-4bba-9eb9-28f80ae40b64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:24.867142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e7758-3f05-4bba-9eb9-28f80ae40b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:24.869725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e7758-3f05-4bba-9eb9-28f80ae40b64 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:24.877996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 97/194] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:24.878810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e7758-3f05-4bba-9eb9-28f80ae40b64 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.879354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-84279434-c7aa-415e-848a-005b3b17e0e9 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:24.880543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-84279434-c7aa-415e-848a-005b3b17e0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:24.904223 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:24.948828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 98/195] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:24.950045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84279434-c7aa-415e-848a-005b3b17e0e9 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:24.994574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e7758-3f05-4bba-9eb9-28f80ae40b64 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:25.003914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:25.029916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18008f-db5f-477c-85ed-427efe6fcd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:25.030819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18008f-db5f-477c-85ed-427efe6fcd4f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:25.031108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18008f-db5f-477c-85ed-427efe6fcd4f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:25.031385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18008f-db5f-477c-85ed-427efe6fcd4f None admin] PATH_INFO: `/v3/users/13b1097ca9874f5bb016cf6f5520913b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:25.045141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18008f-db5f-477c-85ed-427efe6fcd4f None admin] RBAC: Authorizing `identity:get_user(user_id=13b1097ca9874f5bb016cf6f5520913b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:25.046466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84279434-c7aa-415e-848a-005b3b17e0e9 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:25.046634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18008f-db5f-477c-85ed-427efe6fcd4f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:25.048299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 98/196] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/users/13b1097ca9874f5bb016cf6f5520913b => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:25.049061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18008f-db5f-477c-85ed-427efe6fcd4f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:25.081068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee6f49-5f53-4b44-92f5-cbe40303b09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:25.081634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee6f49-5f53-4b44-92f5-cbe40303b09e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:25.081915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee6f49-5f53-4b44-92f5-cbe40303b09e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:25.082192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee6f49-5f53-4b44-92f5-cbe40303b09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:25.133014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:25.150292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee6f49-5f53-4b44-92f5-cbe40303b09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:25.151747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee6f49-5f53-4b44-92f5-cbe40303b09e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:25.155767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18008f-db5f-477c-85ed-427efe6fcd4f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:25.191457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9458ae5-b0d4-4d91-be49-be8715b6949f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:25.192328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9458ae5-b0d4-4d91-be49-be8715b6949f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:25.192611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9458ae5-b0d4-4d91-be49-be8715b6949f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:25.192888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9458ae5-b0d4-4d91-be49-be8715b6949f None admin] PATH_INFO: `/v3/users/13b1097ca9874f5bb016cf6f5520913b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:25.194083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9458ae5-b0d4-4d91-be49-be8715b6949f None admin] RBAC: Authorizing `identity:get_user(user_id=13b1097ca9874f5bb016cf6f5520913b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:25.195572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9458ae5-b0d4-4d91-be49-be8715b6949f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:25.198166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 99/197] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:25 2022] GET /identity/v3/users/13b1097ca9874f5bb016cf6f5520913b => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:25.198945 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9458ae5-b0d4-4d91-be49-be8715b6949f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:25.208984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:25.253594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 99/198] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:25.254505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee6f49-5f53-4b44-92f5-cbe40303b09e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:25.301920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9458ae5-b0d4-4d91-be49-be8715b6949f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:25.337862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803277d9-850c-4ef2-9412-71644fb7e782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:25.338625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803277d9-850c-4ef2-9412-71644fb7e782 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:25.338904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803277d9-850c-4ef2-9412-71644fb7e782 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:25.339176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803277d9-850c-4ef2-9412-71644fb7e782 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:25.341389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803277d9-850c-4ef2-9412-71644fb7e782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:25.343116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803277d9-850c-4ef2-9412-71644fb7e782 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:25.344776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 100/199] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:25.345645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803277d9-850c-4ef2-9412-71644fb7e782 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:25.362381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee6f49-5f53-4b44-92f5-cbe40303b09e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:25.369394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:25.398237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85d190-1a60-4911-be33-cd969c1f67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:25.398915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85d190-1a60-4911-be33-cd969c1f67d1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:25.399257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85d190-1a60-4911-be33-cd969c1f67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:25.400074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85d190-1a60-4911-be33-cd969c1f67d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:25.426986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:25.464300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803277d9-850c-4ef2-9412-71644fb7e782 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:25.471953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85d190-1a60-4911-be33-cd969c1f67d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:25.473438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85d190-1a60-4911-be33-cd969c1f67d1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:25.511308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1116348-d73c-48f3-888e-e99d0340bb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:25.511960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1116348-d73c-48f3-888e-e99d0340bb30 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:25.512244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1116348-d73c-48f3-888e-e99d0340bb30 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:25.512522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1116348-d73c-48f3-888e-e99d0340bb30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:25.590693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1116348-d73c-48f3-888e-e99d0340bb30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:25.592098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1116348-d73c-48f3-888e-e99d0340bb30 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:25.593540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 100/200] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:25.594536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85d190-1a60-4911-be33-cd969c1f67d1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:25.612371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:25.655688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:25.699103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 101/201] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:25.699924 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1116348-d73c-48f3-888e-e99d0340bb30 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:25.707522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85d190-1a60-4911-be33-cd969c1f67d1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:25.742031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9314b9d-3fc4-4485-bde1-37ba7f94f302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:25.742921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9314b9d-3fc4-4485-bde1-37ba7f94f302 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:25.743228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9314b9d-3fc4-4485-bde1-37ba7f94f302 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:25.743524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9314b9d-3fc4-4485-bde1-37ba7f94f302 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:25.744761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9314b9d-3fc4-4485-bde1-37ba7f94f302 None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:25.746206 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9314b9d-3fc4-4485-bde1-37ba7f94f302 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:25.748172 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 101/202] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:25 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:25.748710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9314b9d-3fc4-4485-bde1-37ba7f94f302 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:25.810853 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1116348-d73c-48f3-888e-e99d0340bb30 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:25.823140 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:25.844759 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4faa7-c403-461c-8760-93ee8e9c1524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:25.845412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4faa7-c403-461c-8760-93ee8e9c1524 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:25.845602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4faa7-c403-461c-8760-93ee8e9c1524 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:25.845952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4faa7-c403-461c-8760-93ee8e9c1524 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:25.846860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4faa7-c403-461c-8760-93ee8e9c1524 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:25.848354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c4faa7-c403-461c-8760-93ee8e9c1524 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:25.856526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9314b9d-3fc4-4485-bde1-37ba7f94f302 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:25.874714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 102/203] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:36:25 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:36:25.875815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4faa7-c403-461c-8760-93ee8e9c1524 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:25.883389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:25.903261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448e5f-7c51-4381-bb67-614b200c0561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:25.904464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448e5f-7c51-4381-bb67-614b200c0561 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:25.904753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448e5f-7c51-4381-bb67-614b200c0561 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:25.905034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448e5f-7c51-4381-bb67-614b200c0561 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:25.907051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448e5f-7c51-4381-bb67-614b200c0561 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:25.908555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448e5f-7c51-4381-bb67-614b200c0561 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:25.911452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 102/204] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:25 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:25.912227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448e5f-7c51-4381-bb67-614b200c0561 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:26.009870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4faa7-c403-461c-8760-93ee8e9c1524 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:26.028547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448e5f-7c51-4381-bb67-614b200c0561 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:26.057803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17fec1-5f24-4c87-9a87-13a078bd5d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:26.058715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17fec1-5f24-4c87-9a87-13a078bd5d5d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:26.058991 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17fec1-5f24-4c87-9a87-13a078bd5d5d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:26.060304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17fec1-5f24-4c87-9a87-13a078bd5d5d None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:26.060634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17fec1-5f24-4c87-9a87-13a078bd5d5d None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:26.061977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17fec1-5f24-4c87-9a87-13a078bd5d5d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:26.063952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 103/205] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:25 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:26.064810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17fec1-5f24-4c87-9a87-13a078bd5d5d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:26.075570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8180c2-eb2a-48a6-ab3e-d505210da610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:26.076446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8180c2-eb2a-48a6-ab3e-d505210da610 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:26.076728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8180c2-eb2a-48a6-ab3e-d505210da610 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:26.077007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8180c2-eb2a-48a6-ab3e-d505210da610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:26.077858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8180c2-eb2a-48a6-ab3e-d505210da610 None admin] RBAC: Adding query filter params (role.id=e3e665bc6a4749e99c8ae8d00deafb3a, scope.project.id=e516b1510c304deca52090a8334ae8fd, user.id=851ddf2e4d904421876928dbfdf30361) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:26.078287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8180c2-eb2a-48a6-ab3e-d505210da610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:26.079892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8180c2-eb2a-48a6-ab3e-d505210da610 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:26.087974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 103/206] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:25 2022] GET /identity/v3/role_assignments?user.id=851ddf2e4d904421876928dbfdf30361&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=e3e665bc6a4749e99c8ae8d00deafb3a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:26.089002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8180c2-eb2a-48a6-ab3e-d505210da610 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:26.115345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:26.184999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:26.216717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17fec1-5f24-4c87-9a87-13a078bd5d5d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:26.250795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8180c2-eb2a-48a6-ab3e-d505210da610 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:26.268488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5964b0-024a-45e4-8651-49a09fbe4a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:26.269550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5964b0-024a-45e4-8651-49a09fbe4a78 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:26.269840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5964b0-024a-45e4-8651-49a09fbe4a78 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:26.270123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5964b0-024a-45e4-8651-49a09fbe4a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:26.271274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5964b0-024a-45e4-8651-49a09fbe4a78 None admin] RBAC: Adding query filter params (role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=0f85f312c90640a8a492326b31767a81, user.id=13b1097ca9874f5bb016cf6f5520913b) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:26.271595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5964b0-024a-45e4-8651-49a09fbe4a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:26.275490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5964b0-024a-45e4-8651-49a09fbe4a78 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:26.284128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 104/207] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:26 2022] GET /identity/v3/role_assignments?user.id=13b1097ca9874f5bb016cf6f5520913b&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:26.302758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5b799-e15a-48a2-8930-3b808d1250c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:26.303701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5b799-e15a-48a2-8930-3b808d1250c9 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:26.304134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5b799-e15a-48a2-8930-3b808d1250c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:26.304556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5b799-e15a-48a2-8930-3b808d1250c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:26.305624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5b799-e15a-48a2-8930-3b808d1250c9 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=0f85f312c90640a8a492326b31767a81, user.id=13b1097ca9874f5bb016cf6f5520913b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:26.306009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5b799-e15a-48a2-8930-3b808d1250c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:26.307725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5b799-e15a-48a2-8930-3b808d1250c9 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:26.314796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 104/208] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:26 2022] GET /identity/v3/role_assignments?user.id=13b1097ca9874f5bb016cf6f5520913b&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:28.254042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bae7e-77ac-42af-88c7-9b685e777899 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.254590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bae7e-77ac-42af-88c7-9b685e777899 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.255090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bae7e-77ac-42af-88c7-9b685e777899 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.257717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 105/209] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:28.268223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1864-bca2-463a-9972-5950ed2d3109 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.269664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1864-bca2-463a-9972-5950ed2d3109 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.270475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1864-bca2-463a-9972-5950ed2d3109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.301619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-946b1864-bca2-463a-9972-5950ed2d3109 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:28.304131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-946b1864-bca2-463a-9972-5950ed2d3109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:28.341821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2c749-3d99-42da-9626-e6e0d6626025 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.342220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2c749-3d99-42da-9626-e6e0d6626025 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.342405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2c749-3d99-42da-9626-e6e0d6626025 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.343997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 106/210] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:28.349048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1441741-d145-4482-9a1a-da66e372a0e2 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.349351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1441741-d145-4482-9a1a-da66e372a0e2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.349608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1441741-d145-4482-9a1a-da66e372a0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.367993 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d1441741-d145-4482-9a1a-da66e372a0e2 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:28.369761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d1441741-d145-4482-9a1a-da66e372a0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:28.438422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 105/211] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:28.440343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ab4c-8998-4dac-8d32-ca747e5858d6 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.440632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ab4c-8998-4dac-8d32-ca747e5858d6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.440911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11ab4c-8998-4dac-8d32-ca747e5858d6 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.442803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 106/212] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:28.451208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb8d60-a414-496f-8158-d390d9bf15a1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.451208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb8d60-a414-496f-8158-d390d9bf15a1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.451208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb8d60-a414-496f-8158-d390d9bf15a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.456672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 107/213] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:28.468354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2bbb8d60-a414-496f-8158-d390d9bf15a1 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:28.469571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2bbb8d60-a414-496f-8158-d390d9bf15a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:28.478367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1441741-d145-4482-9a1a-da66e372a0e2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:28.513089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:28.526972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:28.551710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 107/214] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:28.552385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb8d60-a414-496f-8158-d390d9bf15a1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:28.600744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1441741-d145-4482-9a1a-da66e372a0e2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:28.638882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ac4a-739d-492e-bc9a-392ebf9ee48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:28.639675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ac4a-739d-492e-bc9a-392ebf9ee48e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.639957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ac4a-739d-492e-bc9a-392ebf9ee48e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.640230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16ac4a-739d-492e-bc9a-392ebf9ee48e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.651520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16ac4a-739d-492e-bc9a-392ebf9ee48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-ce16ac4a-739d-492e-bc9a-392ebf9ee48e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:28.659699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:28.660597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:28.661426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 108/215] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:28.662077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ac4a-739d-492e-bc9a-392ebf9ee48e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:28.669985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb8d60-a414-496f-8158-d390d9bf15a1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:28.705309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84dd94-f4f8-49a9-9cf9-fab1517dd6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:28.706101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84dd94-f4f8-49a9-9cf9-fab1517dd6f1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.706410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84dd94-f4f8-49a9-9cf9-fab1517dd6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.706690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84dd94-f4f8-49a9-9cf9-fab1517dd6f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.707865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84dd94-f4f8-49a9-9cf9-fab1517dd6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:28.709377 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84dd94-f4f8-49a9-9cf9-fab1517dd6f1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:28.711268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 108/216] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:28.716526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84dd94-f4f8-49a9-9cf9-fab1517dd6f1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:28.771831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:28.772369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:28.780408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16ac4a-739d-492e-bc9a-392ebf9ee48e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:28.819400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeb7f4-0da6-40f8-aed4-052cde69d0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:28.820200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeb7f4-0da6-40f8-aed4-052cde69d0e9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.820704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeb7f4-0da6-40f8-aed4-052cde69d0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.820809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeb7f4-0da6-40f8-aed4-052cde69d0e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.830309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84dd94-f4f8-49a9-9cf9-fab1517dd6f1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:28.839954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeb7f4-0da6-40f8-aed4-052cde69d0e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-feaeb7f4-0da6-40f8-aed4-052cde69d0e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:28.856886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:28.857778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:28.858615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:28.859225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 109/217] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:28.860525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeb7f4-0da6-40f8-aed4-052cde69d0e9 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:28.870454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424f0a7-96ee-4302-86a3-8c7e47787736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:28.871126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424f0a7-96ee-4302-86a3-8c7e47787736 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.871411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424f0a7-96ee-4302-86a3-8c7e47787736 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.871690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424f0a7-96ee-4302-86a3-8c7e47787736 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.872452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424f0a7-96ee-4302-86a3-8c7e47787736 None admin] RBAC: Adding query filter params (name=member) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:28.872761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424f0a7-96ee-4302-86a3-8c7e47787736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:28.874145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424f0a7-96ee-4302-86a3-8c7e47787736 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:28.882644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 109/218] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:28.883911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c235-ca96-4775-9189-b34503309e51 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:28.884249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c235-ca96-4775-9189-b34503309e51 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:28.884722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c235-ca96-4775-9189-b34503309e51 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:28.886144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 110/219] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:28.886715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3c235-ca96-4775-9189-b34503309e51 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:28.976045 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeb7f4-0da6-40f8-aed4-052cde69d0e9 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:28.987461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3c235-ca96-4775-9189-b34503309e51 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:28.998702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:29.011038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4dfad-e68b-4aab-9269-88e0ebb965ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:29.011709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4dfad-e68b-4aab-9269-88e0ebb965ad None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.012000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4dfad-e68b-4aab-9269-88e0ebb965ad None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.012285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4dfad-e68b-4aab-9269-88e0ebb965ad None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.012995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4dfad-e68b-4aab-9269-88e0ebb965ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:29.014487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4dfad-e68b-4aab-9269-88e0ebb965ad None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:29.022509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63e8c-607c-47ab-ad05-881d3fd9f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:29.023117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63e8c-607c-47ab-ad05-881d3fd9f139 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.023406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63e8c-607c-47ab-ad05-881d3fd9f139 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.023689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63e8c-607c-47ab-ad05-881d3fd9f139 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.024476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63e8c-607c-47ab-ad05-881d3fd9f139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:29.024788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63e8c-607c-47ab-ad05-881d3fd9f139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:29.026541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63e8c-607c-47ab-ad05-881d3fd9f139 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:29.034005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 110/220] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:36:28 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:36:29.036225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 111/221] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:29.039423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4dfad-e68b-4aab-9269-88e0ebb965ad None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:29.039931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112520f-ab9b-4619-bb50-aca96b7c4908 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.041010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112520f-ab9b-4619-bb50-aca96b7c4908 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.041343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112520f-ab9b-4619-bb50-aca96b7c4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.055116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:29.063122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-3112520f-ab9b-4619-bb50-aca96b7c4908 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:29.064917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3112520f-ab9b-4619-bb50-aca96b7c4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:29.160193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 112/222] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:29.160890 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112520f-ab9b-4619-bb50-aca96b7c4908 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:29.177833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4dfad-e68b-4aab-9269-88e0ebb965ad None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:29.218189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b708b-7845-4343-a23d-6d57acf57f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:29.219109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b708b-7845-4343-a23d-6d57acf57f48 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.219414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b708b-7845-4343-a23d-6d57acf57f48 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.219681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b708b-7845-4343-a23d-6d57acf57f48 None admin] PATH_INFO: `/v3/users/70dd0109d83c49fa835666584a94b115` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.240261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b708b-7845-4343-a23d-6d57acf57f48 None admin] RBAC: Authorizing `identity:get_user(user_id=70dd0109d83c49fa835666584a94b115)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:29.240261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b708b-7845-4343-a23d-6d57acf57f48 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:29.240799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 111/223] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:29 2022] GET /identity/v3/users/70dd0109d83c49fa835666584a94b115 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:29.241664 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b708b-7845-4343-a23d-6d57acf57f48 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:29.293115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112520f-ab9b-4619-bb50-aca96b7c4908 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:29.294704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:29.336438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:29.351276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e37da-efd4-4533-bd7b-da60bed4d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:29.353489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e37da-efd4-4533-bd7b-da60bed4d35d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.353489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e37da-efd4-4533-bd7b-da60bed4d35d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.353489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e37da-efd4-4533-bd7b-da60bed4d35d None admin] PATH_INFO: `/v3/users/13b1097ca9874f5bb016cf6f5520913b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.354935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e37da-efd4-4533-bd7b-da60bed4d35d None admin] RBAC: Authorizing `identity:get_user(user_id=13b1097ca9874f5bb016cf6f5520913b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:29.356615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e37da-efd4-4533-bd7b-da60bed4d35d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:29.358830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 113/224] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:29 2022] GET /identity/v3/users/13b1097ca9874f5bb016cf6f5520913b => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:29.359823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e37da-efd4-4533-bd7b-da60bed4d35d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:29.384362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b708b-7845-4343-a23d-6d57acf57f48 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:29.431382 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c6ed-b99b-4982-a5ba-c63a65951317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:29.432501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c6ed-b99b-4982-a5ba-c63a65951317 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.432859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c6ed-b99b-4982-a5ba-c63a65951317 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.433252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c6ed-b99b-4982-a5ba-c63a65951317 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.449052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65c6ed-b99b-4982-a5ba-c63a65951317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-ef65c6ed-b99b-4982-a5ba-c63a65951317 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:29.458234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:29.459208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:29.460054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:29.465564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 112/225] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:29.466828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c6ed-b99b-4982-a5ba-c63a65951317 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:29.475653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e37da-efd4-4533-bd7b-da60bed4d35d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:29.511980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb6f48-636a-48b9-964d-58593bb2668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:29.512958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb6f48-636a-48b9-964d-58593bb2668f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.513413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb6f48-636a-48b9-964d-58593bb2668f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.513862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb6f48-636a-48b9-964d-58593bb2668f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.558190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:29.586001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb6f48-636a-48b9-964d-58593bb2668f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:29.588397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb6f48-636a-48b9-964d-58593bb2668f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:29.589764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c6ed-b99b-4982-a5ba-c63a65951317 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:29.619571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:29.629316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37c610-5325-4f88-9008-4a67e70aeff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:29.630555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37c610-5325-4f88-9008-4a67e70aeff4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.630980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37c610-5325-4f88-9008-4a67e70aeff4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.631396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37c610-5325-4f88-9008-4a67e70aeff4 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.632799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37c610-5325-4f88-9008-4a67e70aeff4 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:29.635233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37c610-5325-4f88-9008-4a67e70aeff4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:29.637157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 113/226] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:29 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:29.642903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37c610-5325-4f88-9008-4a67e70aeff4 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:29.708841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 114/227] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:29.713829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb6f48-636a-48b9-964d-58593bb2668f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:29.792549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:29.794050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37c610-5325-4f88-9008-4a67e70aeff4 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:29.837581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c8c93-2eaa-451d-bb8e-c86c230536d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:29.838833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb6f48-636a-48b9-964d-58593bb2668f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:29.839133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8c93-2eaa-451d-bb8e-c86c230536d6 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.839519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8c93-2eaa-451d-bb8e-c86c230536d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.839897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8c93-2eaa-451d-bb8e-c86c230536d6 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.841063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8c93-2eaa-451d-bb8e-c86c230536d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:29.842308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8c93-2eaa-451d-bb8e-c86c230536d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:29.843798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8c93-2eaa-451d-bb8e-c86c230536d6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:29.856225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 114/228] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:29.857375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c8c93-2eaa-451d-bb8e-c86c230536d6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:29.886141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc2c4-8a70-4515-be9f-196db594418a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:29.887389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc2c4-8a70-4515-be9f-196db594418a None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:29.887680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc2c4-8a70-4515-be9f-196db594418a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:29.888139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fc2c4-8a70-4515-be9f-196db594418a None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81/users/13b1097ca9874f5bb016cf6f5520913b/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:29.891071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fc2c4-8a70-4515-be9f-196db594418a None admin] RBAC: Authorizing `identity:create_grant(project_id=0f85f312c90640a8a492326b31767a81, user_id=13b1097ca9874f5bb016cf6f5520913b, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:29.893247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fc2c4-8a70-4515-be9f-196db594418a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:29.914721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 115/229] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:36:29 2022] PUT /identity/v3/projects/0f85f312c90640a8a492326b31767a81/users/13b1097ca9874f5bb016cf6f5520913b/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:29.916274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc2c4-8a70-4515-be9f-196db594418a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:29.929108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:29.994212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c8c93-2eaa-451d-bb8e-c86c230536d6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:30.036772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fc2c4-8a70-4515-be9f-196db594418a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:30.037659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3038-5207-4b62-82e6-c8187e71f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:30.038664 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3038-5207-4b62-82e6-c8187e71f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:30.039013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3038-5207-4b62-82e6-c8187e71f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:30.039364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3038-5207-4b62-82e6-c8187e71f8c5 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:30.041367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3038-5207-4b62-82e6-c8187e71f8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:30.043008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87f3038-5207-4b62-82e6-c8187e71f8c5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:30.045265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 115/230] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:29 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:30.061201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3038-5207-4b62-82e6-c8187e71f8c5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:30.075881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:30.083838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da5248-dbb4-47ad-91e5-4b9bff0b7966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:30.084796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da5248-dbb4-47ad-91e5-4b9bff0b7966 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:30.085078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da5248-dbb4-47ad-91e5-4b9bff0b7966 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:30.085357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da5248-dbb4-47ad-91e5-4b9bff0b7966 None admin] PATH_INFO: `/v3/users/13b1097ca9874f5bb016cf6f5520913b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:30.086789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da5248-dbb4-47ad-91e5-4b9bff0b7966 None admin] RBAC: Authorizing `identity:get_user(user_id=13b1097ca9874f5bb016cf6f5520913b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:30.088774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da5248-dbb4-47ad-91e5-4b9bff0b7966 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:30.091044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 116/231] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:29 2022] GET /identity/v3/users/13b1097ca9874f5bb016cf6f5520913b => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:30.097159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da5248-dbb4-47ad-91e5-4b9bff0b7966 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:30.243940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3038-5207-4b62-82e6-c8187e71f8c5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:30.259265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da5248-dbb4-47ad-91e5-4b9bff0b7966 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:30.278228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:30.303043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0252ad-01b4-430e-a077-7a6b45b4d2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:30.303714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0252ad-01b4-430e-a077-7a6b45b4d2b5 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:30.303999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0252ad-01b4-430e-a077-7a6b45b4d2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:30.304277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0252ad-01b4-430e-a077-7a6b45b4d2b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:30.305121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0252ad-01b4-430e-a077-7a6b45b4d2b5 None admin] RBAC: Adding query filter params (role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=0f85f312c90640a8a492326b31767a81, user.id=70dd0109d83c49fa835666584a94b115) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:30.305433 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0252ad-01b4-430e-a077-7a6b45b4d2b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:30.307387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0252ad-01b4-430e-a077-7a6b45b4d2b5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:30.313659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 116/232] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:30 2022] GET /identity/v3/role_assignments?user.id=70dd0109d83c49fa835666584a94b115&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:30.324055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040e9ac-fcd0-4db5-a49e-19e43c7365b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:30.325756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e9ac-fcd0-4db5-a49e-19e43c7365b9 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:30.326239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e9ac-fcd0-4db5-a49e-19e43c7365b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:30.326746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040e9ac-fcd0-4db5-a49e-19e43c7365b9 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:30.331347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040e9ac-fcd0-4db5-a49e-19e43c7365b9 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:30.333201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040e9ac-fcd0-4db5-a49e-19e43c7365b9 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:30.335739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 117/233] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:30 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:30.341660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0252ad-01b4-430e-a077-7a6b45b4d2b5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:30.510966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0252ad-01b4-430e-a077-7a6b45b4d2b5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:30.567716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57fb78-e321-47f8-9282-baaff74e75b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:30.568981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57fb78-e321-47f8-9282-baaff74e75b1 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:30.569455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57fb78-e321-47f8-9282-baaff74e75b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:30.569936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57fb78-e321-47f8-9282-baaff74e75b1 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81/users/13b1097ca9874f5bb016cf6f5520913b/roles/5e9864ab3b774da195d4d0b7282074ab` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:30.572441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57fb78-e321-47f8-9282-baaff74e75b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f85f312c90640a8a492326b31767a81, user_id=13b1097ca9874f5bb016cf6f5520913b, role_id=5e9864ab3b774da195d4d0b7282074ab)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:30.574093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57fb78-e321-47f8-9282-baaff74e75b1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:30.591581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 117/234] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:36:30 2022] PUT /identity/v3/projects/0f85f312c90640a8a492326b31767a81/users/13b1097ca9874f5bb016cf6f5520913b/roles/5e9864ab3b774da195d4d0b7282074ab => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:31.619717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cfdf8-93d9-4324-8784-ff3ca4eaa1f3 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:31.620659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cfdf8-93d9-4324-8784-ff3ca4eaa1f3 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:31.621129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cfdf8-93d9-4324-8784-ff3ca4eaa1f3 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:31.622772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 118/235] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:31.628321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a108-a363-4cb0-a534-b08d05e29b97 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:31.629166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a108-a363-4cb0-a534-b08d05e29b97 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:31.629656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a108-a363-4cb0-a534-b08d05e29b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:31.641647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00071a01-1fe0-44bb-9508-3b0434e664a1 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:31.642272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00071a01-1fe0-44bb-9508-3b0434e664a1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:31.642789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00071a01-1fe0-44bb-9508-3b0434e664a1 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:31.644354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 119/236] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:36:31.655432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a72f4-4f3b-46ca-8a78-88b8bd817091 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:31.656048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a72f4-4f3b-46ca-8a78-88b8bd817091 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:31.656524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a72f4-4f3b-46ca-8a78-88b8bd817091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:31.658070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d810a108-a363-4cb0-a534-b08d05e29b97 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:31.659335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d810a108-a363-4cb0-a534-b08d05e29b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:31.686122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-400a72f4-4f3b-46ca-8a78-88b8bd817091 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:31.687385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-400a72f4-4f3b-46ca-8a78-88b8bd817091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:31.738805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:31.772027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 118/237] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:31.777091 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:31.792932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 120/238] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:31.796110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810a108-a363-4cb0-a534-b08d05e29b97 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:31.834469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a72f4-4f3b-46ca-8a78-88b8bd817091 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:31.910722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810a108-a363-4cb0-a534-b08d05e29b97 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:31.953098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d675-bad0-4666-b686-94f2d35036f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:31.954133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d675-bad0-4666-b686-94f2d35036f8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:31.954594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d675-bad0-4666-b686-94f2d35036f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:31.955037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d675-bad0-4666-b686-94f2d35036f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:31.968312 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29d675-bad0-4666-b686-94f2d35036f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-6f29d675-bad0-4666-b686-94f2d35036f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:31.976143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:31.977198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:31.978414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:31.985083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 119/239] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:31.986443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d675-bad0-4666-b686-94f2d35036f8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:32.031432 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:32.084535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a72f4-4f3b-46ca-8a78-88b8bd817091 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:32.097181 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d675-bad0-4666-b686-94f2d35036f8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:32.134947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733e136-efef-4c8c-9ea7-d9bc312b8fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:32.135965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e136-efef-4c8c-9ea7-d9bc312b8fe4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:32.136446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e136-efef-4c8c-9ea7-d9bc312b8fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:32.136951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733e136-efef-4c8c-9ea7-d9bc312b8fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:32.137896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733e136-efef-4c8c-9ea7-d9bc312b8fe4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:32.138421 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733e136-efef-4c8c-9ea7-d9bc312b8fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:32.140026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733e136-efef-4c8c-9ea7-d9bc312b8fe4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:32.154891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 120/240] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:32.155821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733e136-efef-4c8c-9ea7-d9bc312b8fe4 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:32.169003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbadc11-0d33-499a-873e-b9115e2f51d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:32.170124 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbadc11-0d33-499a-873e-b9115e2f51d8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:32.170628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbadc11-0d33-499a-873e-b9115e2f51d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:32.171103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbadc11-0d33-499a-873e-b9115e2f51d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:32.172567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbadc11-0d33-499a-873e-b9115e2f51d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:32.174269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbadc11-0d33-499a-873e-b9115e2f51d8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:32.179115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 121/241] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:32.184813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbadc11-0d33-499a-873e-b9115e2f51d8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:32.318284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733e136-efef-4c8c-9ea7-d9bc312b8fe4 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:32.320484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:32.335753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:32.358167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b03e4-d2a7-44bb-bb8d-2a30283fbd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:32.359444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b03e4-d2a7-44bb-bb8d-2a30283fbd56 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:32.359935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b03e4-d2a7-44bb-bb8d-2a30283fbd56 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:32.360405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b03e4-d2a7-44bb-bb8d-2a30283fbd56 None admin] PATH_INFO: `/v3/users/3bf91edc34754cb4a8e419c8ab0f1949` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:32.375943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b03e4-d2a7-44bb-bb8d-2a30283fbd56 None admin] RBAC: Authorizing `identity:get_user(user_id=3bf91edc34754cb4a8e419c8ab0f1949)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:32.377746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b03e4-d2a7-44bb-bb8d-2a30283fbd56 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:32.384812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 121/242] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:32 2022] GET /identity/v3/users/3bf91edc34754cb4a8e419c8ab0f1949 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:32.386274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b03e4-d2a7-44bb-bb8d-2a30283fbd56 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:32.449053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbadc11-0d33-499a-873e-b9115e2f51d8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:32.497249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b03e4-d2a7-44bb-bb8d-2a30283fbd56 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:32.537785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e504b4-b5a1-4ca0-838b-5d3bea806b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:32.539299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e504b4-b5a1-4ca0-838b-5d3bea806b49 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:32.539299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e504b4-b5a1-4ca0-838b-5d3bea806b49 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:32.539593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e504b4-b5a1-4ca0-838b-5d3bea806b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:32.542513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6ee5d-e7c4-4152-9649-0319784e3f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:32.543434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6ee5d-e7c4-4152-9649-0319784e3f7d None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:32.543912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6ee5d-e7c4-4152-9649-0319784e3f7d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:32.544381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6ee5d-e7c4-4152-9649-0319784e3f7d None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:32.545317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6ee5d-e7c4-4152-9649-0319784e3f7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:32.546998 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6ee5d-e7c4-4152-9649-0319784e3f7d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:32.572834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 122/243] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:36:32 2022] POST /identity/v3/users => generated 293 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:36:32.582745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:32.644971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e504b4-b5a1-4ca0-838b-5d3bea806b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:32.646375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e504b4-b5a1-4ca0-838b-5d3bea806b49 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:32.770199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 122/244] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:32.772452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6ee5d-e7c4-4152-9649-0319784e3f7d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:32.890793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701032c-c674-4c5d-954f-3d6691bf97ef None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:32.891700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701032c-c674-4c5d-954f-3d6691bf97ef None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:32.892437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701032c-c674-4c5d-954f-3d6691bf97ef None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:32.895307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 123/245] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:32.903315 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d00f-477c-46b7-93fd-e0964239e602 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:32.903918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d00f-477c-46b7-93fd-e0964239e602 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:32.904402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632d00f-477c-46b7-93fd-e0964239e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:32.926895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f632d00f-477c-46b7-93fd-e0964239e602 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:32.928072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6ee5d-e7c4-4152-9649-0319784e3f7d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:32.928686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f632d00f-477c-46b7-93fd-e0964239e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:32.957868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:32.983356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e6502-bbbc-4ac5-bb9c-bb2ee720deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:32.984629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e6502-bbbc-4ac5-bb9c-bb2ee720deb1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:32.985146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e6502-bbbc-4ac5-bb9c-bb2ee720deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:32.985628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e6502-bbbc-4ac5-bb9c-bb2ee720deb1 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:32.987157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e6502-bbbc-4ac5-bb9c-bb2ee720deb1 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:32.988996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e6502-bbbc-4ac5-bb9c-bb2ee720deb1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:32.996000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 123/246] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:32 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:32.997697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4f3d6-1781-4590-9b2e-7f1a71c8cabe None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:32.998134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4f3d6-1781-4590-9b2e-7f1a71c8cabe None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:32.998722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4f3d6-1781-4590-9b2e-7f1a71c8cabe None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:33.000315 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 124/247] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:33.001679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4f3d6-1781-4590-9b2e-7f1a71c8cabe None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:33.006725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:33.019385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 124/248] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:33.020678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2a593-70e0-4fd9-905f-f90d6bc4f2d6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:33.020971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2a593-70e0-4fd9-905f-f90d6bc4f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:33.021252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2a593-70e0-4fd9-905f-f90d6bc4f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:33.055411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-e1f2a593-70e0-4fd9-905f-f90d6bc4f2d6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:33.056942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e1f2a593-70e0-4fd9-905f-f90d6bc4f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:33.138482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 125/249] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:33.139739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2a593-70e0-4fd9-905f-f90d6bc4f2d6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:33.143424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4f3d6-1781-4590-9b2e-7f1a71c8cabe None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:33.183555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb88b9-4469-4017-9828-0e87624444c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:33.184133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb88b9-4469-4017-9828-0e87624444c5 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:33.184415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb88b9-4469-4017-9828-0e87624444c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:33.184691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb88b9-4469-4017-9828-0e87624444c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:33.185525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb88b9-4469-4017-9828-0e87624444c5 None admin] RBAC: Adding query filter params (role.id=e3e665bc6a4749e99c8ae8d00deafb3a, scope.project.id=0f85f312c90640a8a492326b31767a81, user.id=3bf91edc34754cb4a8e419c8ab0f1949) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:33.185839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb88b9-4469-4017-9828-0e87624444c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:33.188944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb88b9-4469-4017-9828-0e87624444c5 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:33.195665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 125/250] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:33 2022] GET /identity/v3/role_assignments?user.id=3bf91edc34754cb4a8e419c8ab0f1949&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=e3e665bc6a4749e99c8ae8d00deafb3a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:33.196929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb88b9-4469-4017-9828-0e87624444c5 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:33.276564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:33.328026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2a593-70e0-4fd9-905f-f90d6bc4f2d6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:33.351926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:33.369457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edd52-7283-47da-b9ca-0a75b6fceea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:33.370364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edd52-7283-47da-b9ca-0a75b6fceea6 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:33.370662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edd52-7283-47da-b9ca-0a75b6fceea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:33.370950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edd52-7283-47da-b9ca-0a75b6fceea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:33.388259 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8edd52-7283-47da-b9ca-0a75b6fceea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-cb8edd52-7283-47da-b9ca-0a75b6fceea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:33.397083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:33.398052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:33.398919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:33.402484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb88b9-4469-4017-9828-0e87624444c5 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:33.402844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 126/251] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:33.413500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edd52-7283-47da-b9ca-0a75b6fceea6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:33.456128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb085945-3fe8-44b6-a708-4967cfccde94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:33.456882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb085945-3fe8-44b6-a708-4967cfccde94 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:33.457454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb085945-3fe8-44b6-a708-4967cfccde94 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:33.457736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb085945-3fe8-44b6-a708-4967cfccde94 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:33.469429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb085945-3fe8-44b6-a708-4967cfccde94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-eb085945-3fe8-44b6-a708-4967cfccde94 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:33.477372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:33.478428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:33.479250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 126/252] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:33.489681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb085945-3fe8-44b6-a708-4967cfccde94 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:33.598081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edd52-7283-47da-b9ca-0a75b6fceea6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:33.685992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880afa6-aa84-4ff3-9dc4-602de050bd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:33.687762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880afa6-aa84-4ff3-9dc4-602de050bd68 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:33.689069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880afa6-aa84-4ff3-9dc4-602de050bd68 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:33.690086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880afa6-aa84-4ff3-9dc4-602de050bd68 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:33.692092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880afa6-aa84-4ff3-9dc4-602de050bd68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:33.692786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880afa6-aa84-4ff3-9dc4-602de050bd68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:33.695676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880afa6-aa84-4ff3-9dc4-602de050bd68 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:33.717514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 127/253] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:33.724073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880afa6-aa84-4ff3-9dc4-602de050bd68 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:33.765254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb085945-3fe8-44b6-a708-4967cfccde94 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:33.786918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:33.825332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25a847-b305-48f2-99f9-41e8d359ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:33.826010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25a847-b305-48f2-99f9-41e8d359ee6d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:33.826423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25a847-b305-48f2-99f9-41e8d359ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:33.830346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25a847-b305-48f2-99f9-41e8d359ee6d None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:33.830346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25a847-b305-48f2-99f9-41e8d359ee6d None admin] RBAC: Adding query filter params (name=member) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:33.830346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25a847-b305-48f2-99f9-41e8d359ee6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:33.830346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25a847-b305-48f2-99f9-41e8d359ee6d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:33.840084 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:33.850771 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 127/254] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:33.857034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25a847-b305-48f2-99f9-41e8d359ee6d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:33.964365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880afa6-aa84-4ff3-9dc4-602de050bd68 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:34.033548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e654d-030b-491d-bd9c-6602898eec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:34.034788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e654d-030b-491d-bd9c-6602898eec1a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:34.035301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e654d-030b-491d-bd9c-6602898eec1a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:34.035787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e654d-030b-491d-bd9c-6602898eec1a None admin] PATH_INFO: `/v3/users/13b1097ca9874f5bb016cf6f5520913b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:34.037244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e654d-030b-491d-bd9c-6602898eec1a None admin] RBAC: Authorizing `identity:get_user(user_id=13b1097ca9874f5bb016cf6f5520913b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:34.038957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e654d-030b-491d-bd9c-6602898eec1a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:34.040917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 128/255] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:33 2022] GET /identity/v3/users/13b1097ca9874f5bb016cf6f5520913b => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:34.042424 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56852e71-b008-4fed-9787-edb7cae7d9fd None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:34.042926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56852e71-b008-4fed-9787-edb7cae7d9fd None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:34.043405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56852e71-b008-4fed-9787-edb7cae7d9fd None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:34.045008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 129/256] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:34.050202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56852e71-b008-4fed-9787-edb7cae7d9fd None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:34.057052 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25a847-b305-48f2-99f9-41e8d359ee6d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:34.116425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9749684-cc9c-47b2-bbc3-a31bfb3faea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:34.117819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9749684-cc9c-47b2-bbc3-a31bfb3faea6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:34.118898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9749684-cc9c-47b2-bbc3-a31bfb3faea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:34.119629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9749684-cc9c-47b2-bbc3-a31bfb3faea6 None admin] PATH_INFO: `/v3/users/70dd0109d83c49fa835666584a94b115` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:34.121479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9749684-cc9c-47b2-bbc3-a31bfb3faea6 None admin] RBAC: Authorizing `identity:get_user(user_id=70dd0109d83c49fa835666584a94b115)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:34.123279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9749684-cc9c-47b2-bbc3-a31bfb3faea6 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:34.125505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 128/257] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:33 2022] GET /identity/v3/users/70dd0109d83c49fa835666584a94b115 => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:34.127146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee406f-2515-41e5-9b12-3cde9070f245 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:34.127649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee406f-2515-41e5-9b12-3cde9070f245 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:34.128132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee406f-2515-41e5-9b12-3cde9070f245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:34.146154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-77ee406f-2515-41e5-9b12-3cde9070f245 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:34.148207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-77ee406f-2515-41e5-9b12-3cde9070f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:34.226223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:34.248856 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56852e71-b008-4fed-9787-edb7cae7d9fd None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:34.266689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:34.316086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ec89d-8b72-44e5-a1d1-a3142793db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:34.316742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ec89d-8b72-44e5-a1d1-a3142793db7b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:34.317029 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ec89d-8b72-44e5-a1d1-a3142793db7b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:34.317310 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ec89d-8b72-44e5-a1d1-a3142793db7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:34.317902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 129/258] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:34.318782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee406f-2515-41e5-9b12-3cde9070f245 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:34.485306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee406f-2515-41e5-9b12-3cde9070f245 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:34.523218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ec89d-8b72-44e5-a1d1-a3142793db7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:34.524996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ec89d-8b72-44e5-a1d1-a3142793db7b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:34.543283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd782d-48a5-431a-84f4-a472def743d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:34.544161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd782d-48a5-431a-84f4-a472def743d5 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:34.544444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd782d-48a5-431a-84f4-a472def743d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:34.544723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd782d-48a5-431a-84f4-a472def743d5 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:34.547381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd782d-48a5-431a-84f4-a472def743d5 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:34.548845 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd782d-48a5-431a-84f4-a472def743d5 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:34.550597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 130/259] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:34 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:34.552371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd782d-48a5-431a-84f4-a472def743d5 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:34.646777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:34.726461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 130/260] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:34.727305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ec89d-8b72-44e5-a1d1-a3142793db7b None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:34.753872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd782d-48a5-431a-84f4-a472def743d5 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:34.754808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:34.824520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745442ab-d469-430a-827c-e5df422452fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:34.825327 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745442ab-d469-430a-827c-e5df422452fe None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:34.825621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745442ab-d469-430a-827c-e5df422452fe None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:34.825937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745442ab-d469-430a-827c-e5df422452fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:34.843620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745442ab-d469-430a-827c-e5df422452fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-745442ab-d469-430a-827c-e5df422452fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:34.854187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:34.855173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:34.855984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:34.869923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 131/261] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:34.870880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745442ab-d469-430a-827c-e5df422452fe None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:34.930691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ec89d-8b72-44e5-a1d1-a3142793db7b None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:34.971139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4fb02-9f08-43f9-a80b-45681a8aca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:34.972032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4fb02-9f08-43f9-a80b-45681a8aca12 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:34.972314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4fb02-9f08-43f9-a80b-45681a8aca12 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:34.972588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4fb02-9f08-43f9-a80b-45681a8aca12 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81/users/70dd0109d83c49fa835666584a94b115/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:34.975397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4fb02-9f08-43f9-a80b-45681a8aca12 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f85f312c90640a8a492326b31767a81, user_id=70dd0109d83c49fa835666584a94b115, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:34.976845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4fb02-9f08-43f9-a80b-45681a8aca12 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:35.005430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 131/262] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:36:34 2022] PUT /identity/v3/projects/0f85f312c90640a8a492326b31767a81/users/70dd0109d83c49fa835666584a94b115/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:35.006273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4fb02-9f08-43f9-a80b-45681a8aca12 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:35.054526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:35.061634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745442ab-d469-430a-827c-e5df422452fe None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:35.106691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f684b6-7d85-435d-9efd-764618cde25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:35.107640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f684b6-7d85-435d-9efd-764618cde25b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:35.107927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f684b6-7d85-435d-9efd-764618cde25b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:35.108206 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f684b6-7d85-435d-9efd-764618cde25b None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:35.109549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f684b6-7d85-435d-9efd-764618cde25b None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:35.111804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f684b6-7d85-435d-9efd-764618cde25b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:35.114088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 132/263] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:34 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:35.121829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f684b6-7d85-435d-9efd-764618cde25b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:35.172097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:35.240900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4fb02-9f08-43f9-a80b-45681a8aca12 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:35.267316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f684b6-7d85-435d-9efd-764618cde25b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:35.320386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5e39-ad9b-427f-864f-ebdd7f2e2343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:35.322036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5e39-ad9b-427f-864f-ebdd7f2e2343 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:35.322762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5e39-ad9b-427f-864f-ebdd7f2e2343 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:35.323248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f5e39-ad9b-427f-864f-ebdd7f2e2343 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:35.324211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f5e39-ad9b-427f-864f-ebdd7f2e2343 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:35.325561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f5e39-ad9b-427f-864f-ebdd7f2e2343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:35.327227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f5e39-ad9b-427f-864f-ebdd7f2e2343 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:35.345982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 132/264] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:35.355404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5e39-ad9b-427f-864f-ebdd7f2e2343 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:35.355754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2333c-2923-43da-a0b2-eaf738d90809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:35.356552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2333c-2923-43da-a0b2-eaf738d90809 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:35.356842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2333c-2923-43da-a0b2-eaf738d90809 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:35.357148 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2333c-2923-43da-a0b2-eaf738d90809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:35.357989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2333c-2923-43da-a0b2-eaf738d90809 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=0f85f312c90640a8a492326b31767a81, user.id=13b1097ca9874f5bb016cf6f5520913b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:35.358306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2333c-2923-43da-a0b2-eaf738d90809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:35.359929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2333c-2923-43da-a0b2-eaf738d90809 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:35.370344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 133/265] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:35 2022] GET /identity/v3/role_assignments?user.id=13b1097ca9874f5bb016cf6f5520913b&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:35.494049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f5e39-ad9b-427f-864f-ebdd7f2e2343 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:35.553585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:35.559689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc6088-4795-43c7-86cc-f34195b1be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:35.560580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6088-4795-43c7-86cc-f34195b1be78 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:35.560867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6088-4795-43c7-86cc-f34195b1be78 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:35.561152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6088-4795-43c7-86cc-f34195b1be78 None admin] PATH_INFO: `/v3/users/13b1097ca9874f5bb016cf6f5520913b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:35.562576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6088-4795-43c7-86cc-f34195b1be78 None admin] RBAC: Authorizing `identity:get_user(user_id=13b1097ca9874f5bb016cf6f5520913b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:35.568097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6088-4795-43c7-86cc-f34195b1be78 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:35.570233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 133/266] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:35 2022] GET /identity/v3/users/13b1097ca9874f5bb016cf6f5520913b => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:35.575914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2333c-2923-43da-a0b2-eaf738d90809 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:35.616012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:35.619237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31dd32-bc9f-4cdf-b076-3e01504e31ae None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:35.619538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31dd32-bc9f-4cdf-b076-3e01504e31ae None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:35.619932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31dd32-bc9f-4cdf-b076-3e01504e31ae None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:35.622839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 134/267] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:35.627520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f24ef-216c-409e-9a01-facf287a3567 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:35.627923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f24ef-216c-409e-9a01-facf287a3567 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:35.628280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f24ef-216c-409e-9a01-facf287a3567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:35.649095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b02f24ef-216c-409e-9a01-facf287a3567 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:35.651166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b02f24ef-216c-409e-9a01-facf287a3567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:35.756763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2333c-2923-43da-a0b2-eaf738d90809 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:35.780523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 135/268] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:35.816672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f24ef-216c-409e-9a01-facf287a3567 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:35.831811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f7f01-12e1-4b43-97df-1838db99ca28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:35.834301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f7f01-12e1-4b43-97df-1838db99ca28 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:35.834887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f7f01-12e1-4b43-97df-1838db99ca28 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:35.836394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f7f01-12e1-4b43-97df-1838db99ca28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:35.943112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f7f01-12e1-4b43-97df-1838db99ca28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:35.944591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f7f01-12e1-4b43-97df-1838db99ca28 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:35.953330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f24ef-216c-409e-9a01-facf287a3567 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:35.983875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:35.988907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:35.997321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6509d1-2776-4494-b161-7d86e5a22f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:35.998475 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6509d1-2776-4494-b161-7d86e5a22f89 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:35.998768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6509d1-2776-4494-b161-7d86e5a22f89 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:35.999214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6509d1-2776-4494-b161-7d86e5a22f89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.011219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6509d1-2776-4494-b161-7d86e5a22f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-4e6509d1-2776-4494-b161-7d86e5a22f89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:36.018858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:36.019739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 136/269] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:36.026742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778209d-a899-4d6c-bfbc-550879025435 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.028072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778209d-a899-4d6c-bfbc-550879025435 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.028072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778209d-a899-4d6c-bfbc-550879025435 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.028072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 137/270] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:36.028072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734589c-a9df-487f-b2af-5f4a36c99c65 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.028072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734589c-a9df-487f-b2af-5f4a36c99c65 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.028072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734589c-a9df-487f-b2af-5f4a36c99c65 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.028072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 138/271] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:36.031150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734589c-a9df-487f-b2af-5f4a36c99c65 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:36.067621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 134/272] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:36.068728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf7653-5886-4f66-87b7-8c3bdd178a75 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.069024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf7653-5886-4f66-87b7-8c3bdd178a75 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.069307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf7653-5886-4f66-87b7-8c3bdd178a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.087974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-59cf7653-5886-4f66-87b7-8c3bdd178a75 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:36.089173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-59cf7653-5886-4f66-87b7-8c3bdd178a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:36.156286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734589c-a9df-487f-b2af-5f4a36c99c65 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:36.178738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 135/273] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:36.181576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8443-dfac-4392-91a8-eaddd6ce0fb0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.181974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8443-dfac-4392-91a8-eaddd6ce0fb0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.182450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8443-dfac-4392-91a8-eaddd6ce0fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.199086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd6a58-a0a8-4e26-a437-812099e8f8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:36.199996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd6a58-a0a8-4e26-a437-812099e8f8ad None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.200465 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd6a58-a0a8-4e26-a437-812099e8f8ad None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.200878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd6a58-a0a8-4e26-a437-812099e8f8ad None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.201784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd6a58-a0a8-4e26-a437-812099e8f8ad None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:36.202233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd6a58-a0a8-4e26-a437-812099e8f8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:36.202681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2bbd8443-dfac-4392-91a8-eaddd6ce0fb0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:36.203887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2bbd8443-dfac-4392-91a8-eaddd6ce0fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:36.204140 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd6a58-a0a8-4e26-a437-812099e8f8ad None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:36.217824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 139/274] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:36.219064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd6a58-a0a8-4e26-a437-812099e8f8ad None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:36.267436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:36.279842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 136/275] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:36.280696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd8443-dfac-4392-91a8-eaddd6ce0fb0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:36.290757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:36.359399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd6a58-a0a8-4e26-a437-812099e8f8ad None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:36.397319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e8440-efa3-4c94-bf42-74a8daea41c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:36.398225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e8440-efa3-4c94-bf42-74a8daea41c6 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.398679 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e8440-efa3-4c94-bf42-74a8daea41c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.398830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644e8440-efa3-4c94-bf42-74a8daea41c6 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.401081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e8440-efa3-4c94-bf42-74a8daea41c6 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:36.402587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644e8440-efa3-4c94-bf42-74a8daea41c6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:36.404514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 140/276] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:36 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:36.409808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e8440-efa3-4c94-bf42-74a8daea41c6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:36.411426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd8443-dfac-4392-91a8-eaddd6ce0fb0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:36.448809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51123-07f3-46bf-b344-de0b9875e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:36.449607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51123-07f3-46bf-b344-de0b9875e993 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.449892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51123-07f3-46bf-b344-de0b9875e993 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.450170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a51123-07f3-46bf-b344-de0b9875e993 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.451393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51123-07f3-46bf-b344-de0b9875e993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:36.452873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a51123-07f3-46bf-b344-de0b9875e993 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:36.454561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 137/277] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:36.455349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51123-07f3-46bf-b344-de0b9875e993 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:36.526834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:36.534043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644e8440-efa3-4c94-bf42-74a8daea41c6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:36.562990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:36.578770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a51123-07f3-46bf-b344-de0b9875e993 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:36.582291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a1961-04c9-401b-95bf-9e0e33831a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:36.583200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a1961-04c9-401b-95bf-9e0e33831a60 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.583483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a1961-04c9-401b-95bf-9e0e33831a60 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.583755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a1961-04c9-401b-95bf-9e0e33831a60 None admin] PATH_INFO: `/v3/users/f0c04019c4f04fdb8bff54dcf79509dc` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.600737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a1961-04c9-401b-95bf-9e0e33831a60 None admin] RBAC: Authorizing `identity:get_user(user_id=f0c04019c4f04fdb8bff54dcf79509dc)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:36.602295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a1961-04c9-401b-95bf-9e0e33831a60 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:36.604513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 141/278] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:36 2022] GET /identity/v3/users/f0c04019c4f04fdb8bff54dcf79509dc => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:36.605235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a1961-04c9-401b-95bf-9e0e33831a60 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:36.622514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae011f4-0ee1-479f-b989-de78f377f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:36.623626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae011f4-0ee1-479f-b989-de78f377f81c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.623914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae011f4-0ee1-479f-b989-de78f377f81c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.624176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae011f4-0ee1-479f-b989-de78f377f81c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.635280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae011f4-0ee1-479f-b989-de78f377f81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-4ae011f4-0ee1-479f-b989-de78f377f81c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:36.643945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:36.644967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:36.645761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 138/279] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:36.647099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae011f4-0ee1-479f-b989-de78f377f81c None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:36.732518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a1961-04c9-401b-95bf-9e0e33831a60 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:36.755201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae011f4-0ee1-479f-b989-de78f377f81c None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:36.770912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980d2ec-049d-4c35-bd8e-9f2383f444df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:36.771830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980d2ec-049d-4c35-bd8e-9f2383f444df None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.772253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980d2ec-049d-4c35-bd8e-9f2383f444df None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.772679 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980d2ec-049d-4c35-bd8e-9f2383f444df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.773524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980d2ec-049d-4c35-bd8e-9f2383f444df None admin] RBAC: Adding query filter params (role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=0f85f312c90640a8a492326b31767a81, user.id=13b1097ca9874f5bb016cf6f5520913b) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:36.773832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980d2ec-049d-4c35-bd8e-9f2383f444df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:36.775488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980d2ec-049d-4c35-bd8e-9f2383f444df None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:36.776160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:36.782791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 142/280] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:36 2022] GET /identity/v3/role_assignments?user.id=13b1097ca9874f5bb016cf6f5520913b&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:36.783452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980d2ec-049d-4c35-bd8e-9f2383f444df None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:36.808785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab958f5-efaa-4d53-89e3-080b77598948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:36.809905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab958f5-efaa-4d53-89e3-080b77598948 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.810472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab958f5-efaa-4d53-89e3-080b77598948 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.810965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab958f5-efaa-4d53-89e3-080b77598948 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.812616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab958f5-efaa-4d53-89e3-080b77598948 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:36.815172 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab958f5-efaa-4d53-89e3-080b77598948 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:36.841415 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:36.849791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 139/281] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:36:36 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:36:36.859435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab958f5-efaa-4d53-89e3-080b77598948 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:36.945682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980d2ec-049d-4c35-bd8e-9f2383f444df None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:36.995964 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f976a-d052-4dab-8d28-af90097b59e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:36.996633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f976a-d052-4dab-8d28-af90097b59e2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:36.996919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f976a-d052-4dab-8d28-af90097b59e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:36.997197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f976a-d052-4dab-8d28-af90097b59e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:36.998046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f976a-d052-4dab-8d28-af90097b59e2 None admin] RBAC: Adding query filter params (role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, user.id=f0c04019c4f04fdb8bff54dcf79509dc, scope.system=all) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:36.998395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f976a-d052-4dab-8d28-af90097b59e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:37.000857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f976a-d052-4dab-8d28-af90097b59e2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:37.008613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 143/282] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 23 10:36:36 2022] GET /identity/v3/role_assignments?user.id=f0c04019c4f04fdb8bff54dcf79509dc&scope.system=all&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:37.072880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab958f5-efaa-4d53-89e3-080b77598948 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:37.117594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c60a9a-e56a-4878-ab26-fbc1eb0631bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:37.118334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60a9a-e56a-4878-ab26-fbc1eb0631bc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:37.118633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60a9a-e56a-4878-ab26-fbc1eb0631bc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:37.118947 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c60a9a-e56a-4878-ab26-fbc1eb0631bc None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:37.119792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c60a9a-e56a-4878-ab26-fbc1eb0631bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:37.120109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c60a9a-e56a-4878-ab26-fbc1eb0631bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:37.121543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c60a9a-e56a-4878-ab26-fbc1eb0631bc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:37.131410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 140/283] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:37.137326 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f976a-d052-4dab-8d28-af90097b59e2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:37.269227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f976a-d052-4dab-8d28-af90097b59e2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:37.277662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:37.308440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975ae14-71bd-45da-993d-818b977572e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:37.309326 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975ae14-71bd-45da-993d-818b977572e3 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:37.309615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975ae14-71bd-45da-993d-818b977572e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:37.309896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975ae14-71bd-45da-993d-818b977572e3 None admin] PATH_INFO: `/v3/users/3bf91edc34754cb4a8e419c8ab0f1949` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:37.311160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975ae14-71bd-45da-993d-818b977572e3 None admin] RBAC: Authorizing `identity:get_user(user_id=3bf91edc34754cb4a8e419c8ab0f1949)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:37.312734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975ae14-71bd-45da-993d-818b977572e3 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:37.314758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 144/284] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:37 2022] GET /identity/v3/users/3bf91edc34754cb4a8e419c8ab0f1949 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:37.320321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c60a9a-e56a-4878-ab26-fbc1eb0631bc None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:37.368489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:37.439347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c60a9a-e56a-4878-ab26-fbc1eb0631bc None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:37.478004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378049c-92ee-44cc-b4bb-d695ff33bbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:37.479231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378049c-92ee-44cc-b4bb-d695ff33bbc0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:37.479693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378049c-92ee-44cc-b4bb-d695ff33bbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:37.480131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378049c-92ee-44cc-b4bb-d695ff33bbc0 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:37.481513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378049c-92ee-44cc-b4bb-d695ff33bbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:37.483157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c378049c-92ee-44cc-b4bb-d695ff33bbc0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:37.485349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 141/285] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:37 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:37.491136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975ae14-71bd-45da-993d-818b977572e3 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:37.583121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e3ca7-1e08-4e1f-84db-41d7538e066f None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:37.583414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e3ca7-1e08-4e1f-84db-41d7538e066f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:37.583704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e3ca7-1e08-4e1f-84db-41d7538e066f None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:37.585248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 142/286] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:37.600593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a754c-c962-47c8-aa84-448dc1cec4a4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:37.600888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a754c-c962-47c8-aa84-448dc1cec4a4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:37.601178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a754c-c962-47c8-aa84-448dc1cec4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:37.626867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-500a754c-c962-47c8-aa84-448dc1cec4a4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:37.628165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-500a754c-c962-47c8-aa84-448dc1cec4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:37.631020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975ae14-71bd-45da-993d-818b977572e3 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:37.698712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6b13-d379-43dd-9270-058f4153d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:37.701119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6b13-d379-43dd-9270-058f4153d15f None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:37.701762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6b13-d379-43dd-9270-058f4153d15f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:37.702447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e6b13-d379-43dd-9270-058f4153d15f None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81/users/3bf91edc34754cb4a8e419c8ab0f1949/roles/e3e665bc6a4749e99c8ae8d00deafb3a` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:37.711285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6b13-d379-43dd-9270-058f4153d15f None admin] RBAC: Authorizing `identity:create_grant(project_id=0f85f312c90640a8a492326b31767a81, user_id=3bf91edc34754cb4a8e419c8ab0f1949, role_id=e3e665bc6a4749e99c8ae8d00deafb3a)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:37.713362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 143/287] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:37.713968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e6b13-d379-43dd-9270-058f4153d15f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:37.740832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 145/288] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:36:37 2022] PUT /identity/v3/projects/0f85f312c90640a8a492326b31767a81/users/3bf91edc34754cb4a8e419c8ab0f1949/roles/e3e665bc6a4749e99c8ae8d00deafb3a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:36:37.749033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a754c-c962-47c8-aa84-448dc1cec4a4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:37.803450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:37.889907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a754c-c962-47c8-aa84-448dc1cec4a4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:37.945243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb826a7-c246-4184-9036-4a8e2ab991aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:37.946301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb826a7-c246-4184-9036-4a8e2ab991aa None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:37.947226 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb826a7-c246-4184-9036-4a8e2ab991aa None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:37.947512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb826a7-c246-4184-9036-4a8e2ab991aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:37.959542 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb826a7-c246-4184-9036-4a8e2ab991aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-0eb826a7-c246-4184-9036-4a8e2ab991aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:37.968701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:37.969639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:37.970939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 144/289] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:37.975878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6b13-d379-43dd-9270-058f4153d15f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:38.017729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:38.093939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e6b13-d379-43dd-9270-058f4153d15f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:38.131192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b9a21-9f1c-4cfd-a3a6-5d74e2b823b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:38.131869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b9a21-9f1c-4cfd-a3a6-5d74e2b823b0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:38.132153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b9a21-9f1c-4cfd-a3a6-5d74e2b823b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:38.132433 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b9a21-9f1c-4cfd-a3a6-5d74e2b823b0 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:38.133196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b9a21-9f1c-4cfd-a3a6-5d74e2b823b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:38.133505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b9a21-9f1c-4cfd-a3a6-5d74e2b823b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:38.136300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b9a21-9f1c-4cfd-a3a6-5d74e2b823b0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:38.146106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 146/290] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:38.153109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb826a7-c246-4184-9036-4a8e2ab991aa None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:38.282730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:38.293117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb826a7-c246-4184-9036-4a8e2ab991aa None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:38.341833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0328a-2c29-42d5-b64a-ad9a1c72860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:38.342740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0328a-2c29-42d5-b64a-ad9a1c72860c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:38.343028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0328a-2c29-42d5-b64a-ad9a1c72860c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:38.343309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0328a-2c29-42d5-b64a-ad9a1c72860c None admin] PATH_INFO: `/v3/users/70dd0109d83c49fa835666584a94b115` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:38.344551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0328a-2c29-42d5-b64a-ad9a1c72860c None admin] RBAC: Authorizing `identity:get_user(user_id=70dd0109d83c49fa835666584a94b115)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:38.346000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0328a-2c29-42d5-b64a-ad9a1c72860c None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:38.347984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 145/291] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:38 2022] GET /identity/v3/users/70dd0109d83c49fa835666584a94b115 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:38.354018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b9a21-9f1c-4cfd-a3a6-5d74e2b823b0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:38.522435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:38.531314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b9a21-9f1c-4cfd-a3a6-5d74e2b823b0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:38.587048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4c23e-d53d-4dce-8037-03085f74df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:38.588119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4c23e-d53d-4dce-8037-03085f74df51 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:38.588610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4c23e-d53d-4dce-8037-03085f74df51 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:38.589083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4c23e-d53d-4dce-8037-03085f74df51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:38.686498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4c23e-d53d-4dce-8037-03085f74df51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:38.688364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4c23e-d53d-4dce-8037-03085f74df51 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:38.828943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:38.838850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 147/292] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:38.844492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0328a-2c29-42d5-b64a-ad9a1c72860c None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:39.039724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0328a-2c29-42d5-b64a-ad9a1c72860c None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:39.094604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0738a6-7b9b-414d-9fd4-1ca0b5035856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:39.096004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0738a6-7b9b-414d-9fd4-1ca0b5035856 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:39.096506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0738a6-7b9b-414d-9fd4-1ca0b5035856 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:39.097002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0738a6-7b9b-414d-9fd4-1ca0b5035856 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:39.099125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0738a6-7b9b-414d-9fd4-1ca0b5035856 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:39.100722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0738a6-7b9b-414d-9fd4-1ca0b5035856 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:39.105982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 146/293] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:38 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:39.111445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4c23e-d53d-4dce-8037-03085f74df51 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:39.270666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4c23e-d53d-4dce-8037-03085f74df51 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:39.313829 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009a0ee-12bb-491f-b15d-f89ab830a823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:39.315114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009a0ee-12bb-491f-b15d-f89ab830a823 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:39.315592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009a0ee-12bb-491f-b15d-f89ab830a823 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:39.316080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009a0ee-12bb-491f-b15d-f89ab830a823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:39.317153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009a0ee-12bb-491f-b15d-f89ab830a823 None admin] RBAC: Adding query filter params (role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=0f85f312c90640a8a492326b31767a81, user.id=70dd0109d83c49fa835666584a94b115) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:39.317658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009a0ee-12bb-491f-b15d-f89ab830a823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:39.319338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009a0ee-12bb-491f-b15d-f89ab830a823 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:39.330974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 148/294] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:39 2022] GET /identity/v3/role_assignments?user.id=70dd0109d83c49fa835666584a94b115&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:39.628147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf06be3-e082-4d19-bc51-3c47f959772b None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:39.628471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf06be3-e082-4d19-bc51-3c47f959772b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:39.628736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf06be3-e082-4d19-bc51-3c47f959772b None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:39.630455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 147/295] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:39.637521 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56539-f73a-4fa2-9e7b-d0bb98f0d747 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:39.638086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56539-f73a-4fa2-9e7b-d0bb98f0d747 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:39.638587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56539-f73a-4fa2-9e7b-d0bb98f0d747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:39.660453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c9d56539-f73a-4fa2-9e7b-d0bb98f0d747 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:39.661989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c9d56539-f73a-4fa2-9e7b-d0bb98f0d747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:39.742209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:39.770094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 149/296] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:39.794219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf06be3-e082-4d19-bc51-3c47f959772b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:39.815162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac2b9-1b78-4952-9bd0-375f57fba6c5 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:39.815467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac2b9-1b78-4952-9bd0-375f57fba6c5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:39.815702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ac2b9-1b78-4952-9bd0-375f57fba6c5 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:39.819131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 150/297] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:39.822748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf47be-cd74-4bc0-805e-b23c1905ee04 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:39.823038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf47be-cd74-4bc0-805e-b23c1905ee04 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:39.823321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf47be-cd74-4bc0-805e-b23c1905ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:39.846987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8edf47be-cd74-4bc0-805e-b23c1905ee04 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:39.848439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8edf47be-cd74-4bc0-805e-b23c1905ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:39.856342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:39.948391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 151/298] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:39.963675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf06be3-e082-4d19-bc51-3c47f959772b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:39.974851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf47be-cd74-4bc0-805e-b23c1905ee04 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.006485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43b298-57ad-496d-a7ea-d984672ac494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:40.008143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43b298-57ad-496d-a7ea-d984672ac494 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.009494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43b298-57ad-496d-a7ea-d984672ac494 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.010196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43b298-57ad-496d-a7ea-d984672ac494 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.027481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43b298-57ad-496d-a7ea-d984672ac494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-5c43b298-57ad-496d-a7ea-d984672ac494 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:40.035840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:40.036778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:40.037636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:40.040445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 148/299] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:40.047064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43b298-57ad-496d-a7ea-d984672ac494 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.101441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf47be-cd74-4bc0-805e-b23c1905ee04 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:40.128743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:40.146506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d03c19-8fff-4778-86f1-054d2528f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:40.147366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03c19-8fff-4778-86f1-054d2528f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.147670 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03c19-8fff-4778-86f1-054d2528f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.147948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03c19-8fff-4778-86f1-054d2528f9e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.149794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:40.159847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43b298-57ad-496d-a7ea-d984672ac494 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:40.161006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d03c19-8fff-4778-86f1-054d2528f9e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-c0d03c19-8fff-4778-86f1-054d2528f9e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:40.171420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:40.172410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:40.173217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:40.174562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 152/300] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:40.175925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95541c8-6d15-44c5-b6ee-12d4acc7a982 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.176218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95541c8-6d15-44c5-b6ee-12d4acc7a982 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.176500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95541c8-6d15-44c5-b6ee-12d4acc7a982 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.178183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 153/301] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:40.178936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95541c8-6d15-44c5-b6ee-12d4acc7a982 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.206979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa604851-d538-4b41-af8d-01f3de845ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:40.208371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa604851-d538-4b41-af8d-01f3de845ef2 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.208796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa604851-d538-4b41-af8d-01f3de845ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.209081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa604851-d538-4b41-af8d-01f3de845ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.209835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa604851-d538-4b41-af8d-01f3de845ef2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:40.210150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa604851-d538-4b41-af8d-01f3de845ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:40.211747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa604851-d538-4b41-af8d-01f3de845ef2 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:40.221168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 149/302] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:40.222662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609867ba-8835-481e-812c-f1593fc4d365 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.222901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609867ba-8835-481e-812c-f1593fc4d365 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.223164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609867ba-8835-481e-812c-f1593fc4d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.249477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-609867ba-8835-481e-812c-f1593fc4d365 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:40.250840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-609867ba-8835-481e-812c-f1593fc4d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:40.306895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95541c8-6d15-44c5-b6ee-12d4acc7a982 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:40.325995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 150/303] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:40.326905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609867ba-8835-481e-812c-f1593fc4d365 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.352850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36353e-cdf4-4aa7-bd73-f7a6ebe6c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:40.353767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36353e-cdf4-4aa7-bd73-f7a6ebe6c74f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.354052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36353e-cdf4-4aa7-bd73-f7a6ebe6c74f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.354342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36353e-cdf4-4aa7-bd73-f7a6ebe6c74f None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.355131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36353e-cdf4-4aa7-bd73-f7a6ebe6c74f None admin] RBAC: Adding query filter params (name=reader) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:40.355442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36353e-cdf4-4aa7-bd73-f7a6ebe6c74f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:40.356850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36353e-cdf4-4aa7-bd73-f7a6ebe6c74f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:40.366851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 154/304] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:40.372823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36353e-cdf4-4aa7-bd73-f7a6ebe6c74f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.418512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:40.423980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:40.442666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609867ba-8835-481e-812c-f1593fc4d365 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:40.478345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bc2eb-61ba-4347-bb04-e01bde29bbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:40.478904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36353e-cdf4-4aa7-bd73-f7a6ebe6c74f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:40.479233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bc2eb-61ba-4347-bb04-e01bde29bbfa None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.479518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bc2eb-61ba-4347-bb04-e01bde29bbfa None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.479798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bc2eb-61ba-4347-bb04-e01bde29bbfa None admin] PATH_INFO: `/v3/users/f0c04019c4f04fdb8bff54dcf79509dc` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.481097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bc2eb-61ba-4347-bb04-e01bde29bbfa None admin] RBAC: Authorizing `identity:get_user(user_id=f0c04019c4f04fdb8bff54dcf79509dc)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:40.482566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bc2eb-61ba-4347-bb04-e01bde29bbfa None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:40.484246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 151/305] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:40 2022] GET /identity/v3/users/f0c04019c4f04fdb8bff54dcf79509dc => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:40.485037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bc2eb-61ba-4347-bb04-e01bde29bbfa None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.519414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027815f6-9d52-4313-9af9-c372df2eb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:40.519616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027815f6-9d52-4313-9af9-c372df2eb8a7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.519839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027815f6-9d52-4313-9af9-c372df2eb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.520117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027815f6-9d52-4313-9af9-c372df2eb8a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.521345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027815f6-9d52-4313-9af9-c372df2eb8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:40.522851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027815f6-9d52-4313-9af9-c372df2eb8a7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:40.525148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 155/306] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:40.526401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853a1d-ac7c-4a0c-bee4-a3620e62d2ce None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.526692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853a1d-ac7c-4a0c-bee4-a3620e62d2ce None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.526972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853a1d-ac7c-4a0c-bee4-a3620e62d2ce None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.530060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 156/307] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:40.530060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853a1d-ac7c-4a0c-bee4-a3620e62d2ce None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.598606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bc2eb-61ba-4347-bb04-e01bde29bbfa None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:40.635467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c77bc3-177d-4e31-8bc9-8a9b547fe18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:40.636349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c77bc3-177d-4e31-8bc9-8a9b547fe18d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.636647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c77bc3-177d-4e31-8bc9-8a9b547fe18d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.636930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c77bc3-177d-4e31-8bc9-8a9b547fe18d None admin] PATH_INFO: `/v3/users/234c439d30d64470997f2c02632db3e5` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.643715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853a1d-ac7c-4a0c-bee4-a3620e62d2ce None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:40.652550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c77bc3-177d-4e31-8bc9-8a9b547fe18d None admin] RBAC: Authorizing `identity:get_user(user_id=234c439d30d64470997f2c02632db3e5)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:40.654042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c77bc3-177d-4e31-8bc9-8a9b547fe18d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:40.654669 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:40.655847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 152/308] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:40 2022] GET /identity/v3/users/234c439d30d64470997f2c02632db3e5 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:40.656628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c77bc3-177d-4e31-8bc9-8a9b547fe18d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.669996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:40.679301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0a334-2537-4350-ada5-2f6f0ad7bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:40.680169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0a334-2537-4350-ada5-2f6f0ad7bd44 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.681050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0a334-2537-4350-ada5-2f6f0ad7bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.681325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0a334-2537-4350-ada5-2f6f0ad7bd44 None admin] PATH_INFO: `/v3/system/users/f0c04019c4f04fdb8bff54dcf79509dc/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.683032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0a334-2537-4350-ada5-2f6f0ad7bd44 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f0c04019c4f04fdb8bff54dcf79509dc, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:40.684435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0a334-2537-4350-ada5-2f6f0ad7bd44 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:40.693756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 157/309] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jun 23 10:36:40 2022] PUT /identity/v3/system/users/f0c04019c4f04fdb8bff54dcf79509dc/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:40.695148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91601b58-c33e-41c2-9a1e-732cbe06ca8a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.695453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91601b58-c33e-41c2-9a1e-732cbe06ca8a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.695710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91601b58-c33e-41c2-9a1e-732cbe06ca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.716431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-91601b58-c33e-41c2-9a1e-732cbe06ca8a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:40.717673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-91601b58-c33e-41c2-9a1e-732cbe06ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:40.784382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c77bc3-177d-4e31-8bc9-8a9b547fe18d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:40.814374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 158/310] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:40.814374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91601b58-c33e-41c2-9a1e-732cbe06ca8a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.840842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65a169-1d75-4388-a40f-e81ed55bcc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:40.841528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65a169-1d75-4388-a40f-e81ed55bcc2a None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:40.841810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65a169-1d75-4388-a40f-e81ed55bcc2a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:40.842155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65a169-1d75-4388-a40f-e81ed55bcc2a None admin] PATH_INFO: `/v3/groups` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:40.842935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65a169-1d75-4388-a40f-e81ed55bcc2a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:40.844429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65a169-1d75-4388-a40f-e81ed55bcc2a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:40.884702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 153/311] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jun 23 10:36:40 2022] POST /identity/v3/groups => generated 229 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:36:40.886812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65a169-1d75-4388-a40f-e81ed55bcc2a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:40.963732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91601b58-c33e-41c2-9a1e-732cbe06ca8a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:40.967701 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:40.996273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:41.020828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c93b0c-f701-43bb-935d-38c505f57ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:41.021879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c93b0c-f701-43bb-935d-38c505f57ee1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:41.022370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c93b0c-f701-43bb-935d-38c505f57ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:41.022828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c93b0c-f701-43bb-935d-38c505f57ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:41.025207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c93b0c-f701-43bb-935d-38c505f57ee1 None admin] RBAC: Adding query filter params (role.id=e3e665bc6a4749e99c8ae8d00deafb3a, user.id=234c439d30d64470997f2c02632db3e5, scope.system=all) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:41.025851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c93b0c-f701-43bb-935d-38c505f57ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:41.028223 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c93b0c-f701-43bb-935d-38c505f57ee1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:41.038369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 159/312] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 23 10:36:40 2022] GET /identity/v3/role_assignments?user.id=234c439d30d64470997f2c02632db3e5&scope.system=all&role.id=e3e665bc6a4749e99c8ae8d00deafb3a => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:41.047267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65a169-1d75-4388-a40f-e81ed55bcc2a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:41.092446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722e8fb-3d76-4df0-a440-f733248e9ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:41.093546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722e8fb-3d76-4df0-a440-f733248e9ca6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:41.093979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722e8fb-3d76-4df0-a440-f733248e9ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:41.094434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722e8fb-3d76-4df0-a440-f733248e9ca6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:41.110211 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722e8fb-3d76-4df0-a440-f733248e9ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-5722e8fb-3d76-4df0-a440-f733248e9ca6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:41.118544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:41.119855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:41.120676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:41.121289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 154/313] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:41.127635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c93b0c-f701-43bb-935d-38c505f57ee1 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:41.250407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c93b0c-f701-43bb-935d-38c505f57ee1 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:41.293499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60f1f-595a-46ad-b5fc-7ea35a1fde3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:41.294232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60f1f-595a-46ad-b5fc-7ea35a1fde3d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:41.294590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60f1f-595a-46ad-b5fc-7ea35a1fde3d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:41.294872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b60f1f-595a-46ad-b5fc-7ea35a1fde3d None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:41.295642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60f1f-595a-46ad-b5fc-7ea35a1fde3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:41.295953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60f1f-595a-46ad-b5fc-7ea35a1fde3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:41.297356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b60f1f-595a-46ad-b5fc-7ea35a1fde3d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:41.308292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 160/314] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:41.314245 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722e8fb-3d76-4df0-a440-f733248e9ca6 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:41.429140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722e8fb-3d76-4df0-a440-f733248e9ca6 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:41.461344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:41.471710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb78278-a94b-46f6-951f-7854c4031348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:41.472598 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb78278-a94b-46f6-951f-7854c4031348 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:41.472883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb78278-a94b-46f6-951f-7854c4031348 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:41.473160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb78278-a94b-46f6-951f-7854c4031348 None admin] PATH_INFO: `/v3/users/3bf91edc34754cb4a8e419c8ab0f1949` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:41.475016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb78278-a94b-46f6-951f-7854c4031348 None admin] RBAC: Authorizing `identity:get_user(user_id=3bf91edc34754cb4a8e419c8ab0f1949)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:41.476510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb78278-a94b-46f6-951f-7854c4031348 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:41.479579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 155/315] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:41 2022] GET /identity/v3/users/3bf91edc34754cb4a8e419c8ab0f1949 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:41.484884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60f1f-595a-46ad-b5fc-7ea35a1fde3d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:41.526448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:41.623220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b60f1f-595a-46ad-b5fc-7ea35a1fde3d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:41.660954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b13406-ee4d-401e-a6d6-3b6ec9895449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:41.661658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b13406-ee4d-401e-a6d6-3b6ec9895449 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:41.661947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b13406-ee4d-401e-a6d6-3b6ec9895449 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:41.662227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b13406-ee4d-401e-a6d6-3b6ec9895449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:41.737235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b13406-ee4d-401e-a6d6-3b6ec9895449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:41.738754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b13406-ee4d-401e-a6d6-3b6ec9895449 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:41.772151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:41.852951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 161/316] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:41.855414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb78278-a94b-46f6-951f-7854c4031348 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:41.996270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb78278-a94b-46f6-951f-7854c4031348 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:42.035021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e2939-b322-4b7d-b43f-ae62e8b4609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:42.035891 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e2939-b322-4b7d-b43f-ae62e8b4609e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:42.036175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e2939-b322-4b7d-b43f-ae62e8b4609e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:42.036456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e2939-b322-4b7d-b43f-ae62e8b4609e None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:42.037679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e2939-b322-4b7d-b43f-ae62e8b4609e None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:42.039175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e2939-b322-4b7d-b43f-ae62e8b4609e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:42.042038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 156/317] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:41 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:42.047725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b13406-ee4d-401e-a6d6-3b6ec9895449 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:42.155240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b13406-ee4d-401e-a6d6-3b6ec9895449 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:42.191241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:42.198139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9a08b-e29a-4067-abf7-f2917df519c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:42.199296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9a08b-e29a-4067-abf7-f2917df519c9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:42.199779 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9a08b-e29a-4067-abf7-f2917df519c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:42.200250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9a08b-e29a-4067-abf7-f2917df519c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:42.201276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9a08b-e29a-4067-abf7-f2917df519c9 None admin] RBAC: Adding query filter params (role.id=e3e665bc6a4749e99c8ae8d00deafb3a, scope.project.id=0f85f312c90640a8a492326b31767a81, user.id=3bf91edc34754cb4a8e419c8ab0f1949) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:42.201815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9a08b-e29a-4067-abf7-f2917df519c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:42.203495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9a08b-e29a-4067-abf7-f2917df519c9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:42.210482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 162/318] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:36:42 2022] GET /identity/v3/role_assignments?user.id=3bf91edc34754cb4a8e419c8ab0f1949&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=e3e665bc6a4749e99c8ae8d00deafb3a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:42.949388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bced8-8a84-4e5a-b326-4d4b2328862c None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:42.949945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bced8-8a84-4e5a-b326-4d4b2328862c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:42.949945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bced8-8a84-4e5a-b326-4d4b2328862c None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:42.951512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 157/319] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:42.956740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5177157-c986-48b5-9291-b4295ecb98c1 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:42.957193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5177157-c986-48b5-9291-b4295ecb98c1 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:42.957393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5177157-c986-48b5-9291-b4295ecb98c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:42.975865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a5177157-c986-48b5-9291-b4295ecb98c1 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:42.977086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a5177157-c986-48b5-9291-b4295ecb98c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:43.053447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 163/320] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:43.078440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bced8-8a84-4e5a-b326-4d4b2328862c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:43.155167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:43.189826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428ec8c-93dd-4782-af24-fe4fde81f8df None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.190110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428ec8c-93dd-4782-af24-fe4fde81f8df None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.190586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428ec8c-93dd-4782-af24-fe4fde81f8df None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.191993 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 164/321] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:43.197821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf3a0-8cbb-433b-b466-d6bceb0c41ea None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.198109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf3a0-8cbb-433b-b466-d6bceb0c41ea None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.198422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bf3a0-8cbb-433b-b466-d6bceb0c41ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.202492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bced8-8a84-4e5a-b326-4d4b2328862c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:43.221024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c74bf3a0-8cbb-433b-b466-d6bceb0c41ea None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:43.222343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c74bf3a0-8cbb-433b-b466-d6bceb0c41ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:43.245514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957c8e8-f7c5-4ba9-99ca-4efb3ae10a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:43.246379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957c8e8-f7c5-4ba9-99ca-4efb3ae10a85 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.246886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957c8e8-f7c5-4ba9-99ca-4efb3ae10a85 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.247408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957c8e8-f7c5-4ba9-99ca-4efb3ae10a85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.263276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957c8e8-f7c5-4ba9-99ca-4efb3ae10a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-2957c8e8-f7c5-4ba9-99ca-4efb3ae10a85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:43.271942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:43.272909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:43.273734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 158/322] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:43.275152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d057cda-8458-4ca1-8443-4041fe55a7c1 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.275152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d057cda-8458-4ca1-8443-4041fe55a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.275152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d057cda-8458-4ca1-8443-4041fe55a7c1 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.276439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 159/323] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:43.279338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d057cda-8458-4ca1-8443-4041fe55a7c1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:43.299182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 165/324] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:43.300559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c0708-c39b-4922-87c3-ba701d753240 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.300898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c0708-c39b-4922-87c3-ba701d753240 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.301131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c0708-c39b-4922-87c3-ba701d753240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.324374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-727c0708-c39b-4922-87c3-ba701d753240 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:43.325604 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-727c0708-c39b-4922-87c3-ba701d753240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:43.379106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:43.398554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 166/325] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:43.399513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c0708-c39b-4922-87c3-ba701d753240 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:43.411222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d057cda-8458-4ca1-8443-4041fe55a7c1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:43.442259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:43.451869 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14abd7-80d6-4510-97be-fc99f2d0ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:43.452584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14abd7-80d6-4510-97be-fc99f2d0ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.452818 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14abd7-80d6-4510-97be-fc99f2d0ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.453096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14abd7-80d6-4510-97be-fc99f2d0ecb1 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.455162 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14abd7-80d6-4510-97be-fc99f2d0ecb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:43.455162 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14abd7-80d6-4510-97be-fc99f2d0ecb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:43.455576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14abd7-80d6-4510-97be-fc99f2d0ecb1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:43.466553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 160/326] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:43.468309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14abd7-80d6-4510-97be-fc99f2d0ecb1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:43.517170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c0708-c39b-4922-87c3-ba701d753240 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:43.561315 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb088b3-4284-40fd-8abc-aa3734ee6e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:43.562625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb088b3-4284-40fd-8abc-aa3734ee6e64 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.563096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb088b3-4284-40fd-8abc-aa3734ee6e64 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.563499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb088b3-4284-40fd-8abc-aa3734ee6e64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.565676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb088b3-4284-40fd-8abc-aa3734ee6e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:43.568234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb088b3-4284-40fd-8abc-aa3734ee6e64 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:43.571092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 167/327] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:36:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:43.572401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb088b3-4284-40fd-8abc-aa3734ee6e64 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:43.591027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14abd7-80d6-4510-97be-fc99f2d0ecb1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:43.636276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee042-7fc0-452e-b6c7-7195de987599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:43.637074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee042-7fc0-452e-b6c7-7195de987599 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.637360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee042-7fc0-452e-b6c7-7195de987599 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.637642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ee042-7fc0-452e-b6c7-7195de987599 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.643526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:43.649043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ee042-7fc0-452e-b6c7-7195de987599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-ff5ee042-7fc0-452e-b6c7-7195de987599 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:43.657250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:43.658417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:43.659453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:43.660160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 161/328] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:43.660434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee042-7fc0-452e-b6c7-7195de987599 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:43.697507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb088b3-4284-40fd-8abc-aa3734ee6e64 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:43.712813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:43.737607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44e31-727b-419b-844e-0061befe52de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:43.738504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44e31-727b-419b-844e-0061befe52de None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.738786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44e31-727b-419b-844e-0061befe52de None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.739063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44e31-727b-419b-844e-0061befe52de None admin] PATH_INFO: `/v3/users/f0c04019c4f04fdb8bff54dcf79509dc` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.740288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b44e31-727b-419b-844e-0061befe52de None admin] RBAC: Authorizing `identity:get_user(user_id=f0c04019c4f04fdb8bff54dcf79509dc)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:43.741752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b44e31-727b-419b-844e-0061befe52de None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:43.744100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 168/329] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:43 2022] GET /identity/v3/users/f0c04019c4f04fdb8bff54dcf79509dc => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:43.744881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44e31-727b-419b-844e-0061befe52de None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:43.776184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ee042-7fc0-452e-b6c7-7195de987599 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:43.815220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37344572-2841-4958-a671-acd9ac3cc77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:43.815890 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344572-2841-4958-a671-acd9ac3cc77a None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.816173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344572-2841-4958-a671-acd9ac3cc77a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.816448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37344572-2841-4958-a671-acd9ac3cc77a None admin] PATH_INFO: `/v3/groups` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.817149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37344572-2841-4958-a671-acd9ac3cc77a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:43.818607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37344572-2841-4958-a671-acd9ac3cc77a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:43.833277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 162/330] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jun 23 10:36:43 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:36:43.833868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37344572-2841-4958-a671-acd9ac3cc77a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:43.875414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44e31-727b-419b-844e-0061befe52de None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:43.902011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:43.927318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac6c60-6615-44e0-b357-b0d7f7fbf700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:43.928269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac6c60-6615-44e0-b357-b0d7f7fbf700 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:43.928840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac6c60-6615-44e0-b357-b0d7f7fbf700 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:43.929280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac6c60-6615-44e0-b357-b0d7f7fbf700 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:43.931125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac6c60-6615-44e0-b357-b0d7f7fbf700 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:43.931618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac6c60-6615-44e0-b357-b0d7f7fbf700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:43.933263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac6c60-6615-44e0-b357-b0d7f7fbf700 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:43.943658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 169/331] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:43.950671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac6c60-6615-44e0-b357-b0d7f7fbf700 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:43.979881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37344572-2841-4958-a671-acd9ac3cc77a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:43.990932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:44.027885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f12e5-8131-4a5c-9ab1-2b90f3f8a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:44.028568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f12e5-8131-4a5c-9ab1-2b90f3f8a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:44.028920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f12e5-8131-4a5c-9ab1-2b90f3f8a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:44.029211 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f12e5-8131-4a5c-9ab1-2b90f3f8a4c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:44.032661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f12e5-8131-4a5c-9ab1-2b90f3f8a4c1 None admin] RBAC: Adding query filter params (role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, user.id=f0c04019c4f04fdb8bff54dcf79509dc, scope.system=all) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:44.032661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f12e5-8131-4a5c-9ab1-2b90f3f8a4c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:44.032661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f12e5-8131-4a5c-9ab1-2b90f3f8a4c1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:44.052690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 163/332] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 23 10:36:43 2022] GET /identity/v3/role_assignments?user.id=f0c04019c4f04fdb8bff54dcf79509dc&scope.system=all&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:44.084197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac6c60-6615-44e0-b357-b0d7f7fbf700 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:44.130140 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95184fe1-4c1e-4eb5-93f7-2aa20b895153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:44.131086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95184fe1-4c1e-4eb5-93f7-2aa20b895153 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:44.131371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95184fe1-4c1e-4eb5-93f7-2aa20b895153 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:44.131653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95184fe1-4c1e-4eb5-93f7-2aa20b895153 None admin] PATH_INFO: `/v3/users/234c439d30d64470997f2c02632db3e5` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:44.133015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95184fe1-4c1e-4eb5-93f7-2aa20b895153 None admin] RBAC: Authorizing `identity:get_user(user_id=234c439d30d64470997f2c02632db3e5)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:44.135388 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95184fe1-4c1e-4eb5-93f7-2aa20b895153 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:44.137559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 170/333] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:43 2022] GET /identity/v3/users/234c439d30d64470997f2c02632db3e5 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:44.144986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f12e5-8131-4a5c-9ab1-2b90f3f8a4c1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:44.283774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f12e5-8131-4a5c-9ab1-2b90f3f8a4c1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:44.326126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526197b-7e91-45df-8497-0c6f69fb0561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:44.327041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526197b-7e91-45df-8497-0c6f69fb0561 None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:44.327333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526197b-7e91-45df-8497-0c6f69fb0561 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:44.327669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526197b-7e91-45df-8497-0c6f69fb0561 None admin] PATH_INFO: `/v3/system/users/234c439d30d64470997f2c02632db3e5/roles/e3e665bc6a4749e99c8ae8d00deafb3a` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:44.329233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526197b-7e91-45df-8497-0c6f69fb0561 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=234c439d30d64470997f2c02632db3e5, role_id=e3e665bc6a4749e99c8ae8d00deafb3a)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:44.330684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526197b-7e91-45df-8497-0c6f69fb0561 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:44.341441 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 164/334] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jun 23 10:36:44 2022] PUT /identity/v3/system/users/234c439d30d64470997f2c02632db3e5/roles/e3e665bc6a4749e99c8ae8d00deafb3a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:46.773820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4597f-fcb1-472d-8b37-567518a0ada2 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:46.775530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4597f-fcb1-472d-8b37-567518a0ada2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:46.776015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4597f-fcb1-472d-8b37-567518a0ada2 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:46.777630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 171/335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:46.796489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081dd90-5aa2-4033-a038-f0f10d4c4bc0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:46.797432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081dd90-5aa2-4033-a038-f0f10d4c4bc0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:46.797909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081dd90-5aa2-4033-a038-f0f10d4c4bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:46.818221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d081dd90-5aa2-4033-a038-f0f10d4c4bc0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:46.819828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d081dd90-5aa2-4033-a038-f0f10d4c4bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:46.853908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:46.913328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 165/336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:46.956325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4597f-fcb1-472d-8b37-567518a0ada2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:46.991743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea3da-ed80-45b4-b650-ab704820643f None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:46.992096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea3da-ed80-45b4-b650-ab704820643f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:46.992302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ea3da-ed80-45b4-b650-ab704820643f None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:46.993848 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 166/337] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:47.009930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d32696-a384-4292-af9f-28557e730a15 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.010250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d32696-a384-4292-af9f-28557e730a15 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.010517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d32696-a384-4292-af9f-28557e730a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:47.038444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-61d32696-a384-4292-af9f-28557e730a15 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:47.039812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-61d32696-a384-4292-af9f-28557e730a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:47.049028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:47.155401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4597f-fcb1-472d-8b37-567518a0ada2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:47.193658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 167/338] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:47.215074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0662d-5fdd-4029-8a9b-8be800e46ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:47.215895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0662d-5fdd-4029-8a9b-8be800e46ba8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.216178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0662d-5fdd-4029-8a9b-8be800e46ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.216461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0662d-5fdd-4029-8a9b-8be800e46ba8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:47.238157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0662d-5fdd-4029-8a9b-8be800e46ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-9ae0662d-5fdd-4029-8a9b-8be800e46ba8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:47.251897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:47.252867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:47.253655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:47.254286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 172/339] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:47.261489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d32696-a384-4292-af9f-28557e730a15 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:47.280184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0662d-5fdd-4029-8a9b-8be800e46ba8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:47.473197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:47.491105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d32696-a384-4292-af9f-28557e730a15 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:47.528434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0662d-5fdd-4029-8a9b-8be800e46ba8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:47.550766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:47.563212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92411890-2df3-47ee-b076-b379b78ed882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:47.563897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92411890-2df3-47ee-b076-b379b78ed882 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.564182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92411890-2df3-47ee-b076-b379b78ed882 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.564464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92411890-2df3-47ee-b076-b379b78ed882 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:47.565499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92411890-2df3-47ee-b076-b379b78ed882 None admin] RBAC: Adding query filter params (name=member) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:47.565813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92411890-2df3-47ee-b076-b379b78ed882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:47.567262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92411890-2df3-47ee-b076-b379b78ed882 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:47.584180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 168/340] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:47.585565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f492a8-3e90-484c-9395-ac8b6edbc32d None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.585853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f492a8-3e90-484c-9395-ac8b6edbc32d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.586132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f492a8-3e90-484c-9395-ac8b6edbc32d None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:47.588927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 169/341] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:47.596157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f492a8-3e90-484c-9395-ac8b6edbc32d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:47.597440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac407a-bb83-4f52-a468-0eec4c194324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:47.598263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac407a-bb83-4f52-a468-0eec4c194324 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.598573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac407a-bb83-4f52-a468-0eec4c194324 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.598851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac407a-bb83-4f52-a468-0eec4c194324 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:47.620648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac407a-bb83-4f52-a468-0eec4c194324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-b4ac407a-bb83-4f52-a468-0eec4c194324 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:47.631100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:47.632075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:47.633305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 173/342] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:47.635722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2b02f-0995-48ad-8cd7-3931c7013b38 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.635722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2b02f-0995-48ad-8cd7-3931c7013b38 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.635722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2b02f-0995-48ad-8cd7-3931c7013b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:47.657753 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-9ac2b02f-0995-48ad-8cd7-3931c7013b38 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:47.659738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9ac2b02f-0995-48ad-8cd7-3931c7013b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:47.760349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 174/343] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:47.761617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50036d1-22d0-40d3-8757-4d6a43596855 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.761929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50036d1-22d0-40d3-8757-4d6a43596855 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.762282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50036d1-22d0-40d3-8757-4d6a43596855 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:47.763725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 175/344] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:47.764436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50036d1-22d0-40d3-8757-4d6a43596855 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:47.771009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f492a8-3e90-484c-9395-ac8b6edbc32d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:47.819233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb6b8c-d4eb-4621-ad07-3e8d93f7c39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:47.820029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb6b8c-d4eb-4621-ad07-3e8d93f7c39f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.820195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb6b8c-d4eb-4621-ad07-3e8d93f7c39f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.820446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb6b8c-d4eb-4621-ad07-3e8d93f7c39f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:47.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:47.909200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:47.911135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb6b8c-d4eb-4621-ad07-3e8d93f7c39f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:47.913134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb6b8c-d4eb-4621-ad07-3e8d93f7c39f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:47.916836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50036d1-22d0-40d3-8757-4d6a43596855 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:47.967068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6cd38-19ea-4635-9f9c-6940f93ea86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:47.967751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6cd38-19ea-4635-9f9c-6940f93ea86e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.968153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6cd38-19ea-4635-9f9c-6940f93ea86e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.968402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6cd38-19ea-4635-9f9c-6940f93ea86e None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:47.969213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6cd38-19ea-4635-9f9c-6940f93ea86e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:47.969528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6cd38-19ea-4635-9f9c-6940f93ea86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:47.970977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6cd38-19ea-4635-9f9c-6940f93ea86e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:47.983163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 176/345] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:47.984635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c4f30-f455-4d6f-9fbc-20c38d000ae5 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:47.984992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c4f30-f455-4d6f-9fbc-20c38d000ae5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:47.985280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c4f30-f455-4d6f-9fbc-20c38d000ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.005801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-744c4f30-f455-4d6f-9fbc-20c38d000ae5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:48.007163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-744c4f30-f455-4d6f-9fbc-20c38d000ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:48.042108 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 170/346] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:48.043084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb6b8c-d4eb-4621-ad07-3e8d93f7c39f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:48.092430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 177/347] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:48.093745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c4f30-f455-4d6f-9fbc-20c38d000ae5 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:48.130581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:48.219417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb6b8c-d4eb-4621-ad07-3e8d93f7c39f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:48.235165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:48.239781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c4f30-f455-4d6f-9fbc-20c38d000ae5 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:48.261514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a83df-9b61-462a-b296-f9fd3f0b65c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:48.262326 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a83df-9b61-462a-b296-f9fd3f0b65c3 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.262622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a83df-9b61-462a-b296-f9fd3f0b65c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.262892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a83df-9b61-462a-b296-f9fd3f0b65c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.279325 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a83df-9b61-462a-b296-f9fd3f0b65c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-965a83df-9b61-462a-b296-f9fd3f0b65c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:48.291531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:48.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:36:48.294687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:48.295310 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f71f58-a775-4b4f-a384-10324c708c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:48.295404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 171/348] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:48.295476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f71f58-a775-4b4f-a384-10324c708c1c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.295476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f71f58-a775-4b4f-a384-10324c708c1c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.295476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f71f58-a775-4b4f-a384-10324c708c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.295669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a83df-9b61-462a-b296-f9fd3f0b65c3 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:48.396281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f71f58-a775-4b4f-a384-10324c708c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:48.398876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f71f58-a775-4b4f-a384-10324c708c1c None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:48.440787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a83df-9b61-462a-b296-f9fd3f0b65c3 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:48.456200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:48.494590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69384b96-0c10-4add-a0e6-cdcda3672a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:48.495972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69384b96-0c10-4add-a0e6-cdcda3672a37 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.496251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69384b96-0c10-4add-a0e6-cdcda3672a37 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.496539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69384b96-0c10-4add-a0e6-cdcda3672a37 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.498537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69384b96-0c10-4add-a0e6-cdcda3672a37 None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:48.500975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69384b96-0c10-4add-a0e6-cdcda3672a37 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:48.502098 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 172/349] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:48 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:48.502952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69384b96-0c10-4add-a0e6-cdcda3672a37 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:48.515044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:48.528307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 178/350] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:48.529765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6ea47-3129-4824-9bb9-af8cf450468f None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.530124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6ea47-3129-4824-9bb9-af8cf450468f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.530517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6ea47-3129-4824-9bb9-af8cf450468f None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.537410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 179/351] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:48.537410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6ea47-3129-4824-9bb9-af8cf450468f None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:48.658307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69384b96-0c10-4add-a0e6-cdcda3672a37 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:48.670179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6ea47-3129-4824-9bb9-af8cf450468f None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:48.705704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d5179-8a3a-42d5-9af7-3cc81ff6dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:48.706556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5179-8a3a-42d5-9af7-3cc81ff6dd7f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.706840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5179-8a3a-42d5-9af7-3cc81ff6dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.707119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d5179-8a3a-42d5-9af7-3cc81ff6dd7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.718411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d5179-8a3a-42d5-9af7-3cc81ff6dd7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:48.723245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ca81b-9f49-48fc-b6c1-6c0008264856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:48.724027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ca81b-9f49-48fc-b6c1-6c0008264856 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.724313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ca81b-9f49-48fc-b6c1-6c0008264856 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.724588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ca81b-9f49-48fc-b6c1-6c0008264856 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.725349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ca81b-9f49-48fc-b6c1-6c0008264856 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:48.725656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ca81b-9f49-48fc-b6c1-6c0008264856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-b85d5179-8a3a-42d5-9af7-3cc81ff6dd7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:48.726086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:48.727698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:48.728673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 173/352] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:48.729499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ca81b-9f49-48fc-b6c1-6c0008264856 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:48.729582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfc2c9-9a38-4c98-a076-9faa8f91b23b None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.729705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfc2c9-9a38-4c98-a076-9faa8f91b23b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.729984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfc2c9-9a38-4c98-a076-9faa8f91b23b None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.732471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 174/353] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:48.733037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfc2c9-9a38-4c98-a076-9faa8f91b23b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:48.743950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 180/354] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:48.744814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ca81b-9f49-48fc-b6c1-6c0008264856 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:48.790795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:48.820066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:48.875455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfc2c9-9a38-4c98-a076-9faa8f91b23b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:48.879760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ca81b-9f49-48fc-b6c1-6c0008264856 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:48.924863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7a4f-4133-43d5-a9b8-4fb6bd6d8b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:48.925649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7a4f-4133-43d5-a9b8-4fb6bd6d8b95 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.925931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7a4f-4133-43d5-a9b8-4fb6bd6d8b95 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.926208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7a4f-4133-43d5-a9b8-4fb6bd6d8b95 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.931343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb18bea-1b51-4213-9e30-1e79ab0ba04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:48.932923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb18bea-1b51-4213-9e30-1e79ab0ba04f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.933213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb18bea-1b51-4213-9e30-1e79ab0ba04f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.933495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb18bea-1b51-4213-9e30-1e79ab0ba04f None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.934841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb18bea-1b51-4213-9e30-1e79ab0ba04f None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:48.935911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7a4f-4133-43d5-a9b8-4fb6bd6d8b95 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:48.936296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb18bea-1b51-4213-9e30-1e79ab0ba04f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:48.936535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7a4f-4133-43d5-a9b8-4fb6bd6d8b95 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:48.938532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 181/355] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:48 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:48.938655 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 175/356] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:48 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:48.940121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7a4f-4133-43d5-a9b8-4fb6bd6d8b95 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:48.940637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3ba51-1865-4563-80ac-099abb829ce8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:48.940926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3ba51-1865-4563-80ac-099abb829ce8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:48.941202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b3ba51-1865-4563-80ac-099abb829ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:48.968137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-33b3ba51-1865-4563-80ac-099abb829ce8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:48.969325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-33b3ba51-1865-4563-80ac-099abb829ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:49.057937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 182/357] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:49.059518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3cbe4-f0ea-4fbc-a86d-25d0905d4224 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:49.059948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3cbe4-f0ea-4fbc-a86d-25d0905d4224 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:49.060403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3cbe4-f0ea-4fbc-a86d-25d0905d4224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:49.076662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7a4f-4133-43d5-a9b8-4fb6bd6d8b95 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:49.079211 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:49.087337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a9a3cbe4-f0ea-4fbc-a86d-25d0905d4224 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:49.089191 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a9a3cbe4-f0ea-4fbc-a86d-25d0905d4224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:49.120566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044adf10-a0dd-483a-a0e0-41bae2502ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:49.121243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044adf10-a0dd-483a-a0e0-41bae2502ae8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:49.121534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044adf10-a0dd-483a-a0e0-41bae2502ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:49.121815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044adf10-a0dd-483a-a0e0-41bae2502ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:49.122762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044adf10-a0dd-483a-a0e0-41bae2502ae8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:49.122951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044adf10-a0dd-483a-a0e0-41bae2502ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:49.124331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044adf10-a0dd-483a-a0e0-41bae2502ae8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:49.133618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 176/358] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:49.134936 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044adf10-a0dd-483a-a0e0-41bae2502ae8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:49.148473 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:49.175815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 183/359] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:49.176230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3cbe4-f0ea-4fbc-a86d-25d0905d4224 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:49.280192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044adf10-a0dd-483a-a0e0-41bae2502ae8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:49.315060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3cbe4-f0ea-4fbc-a86d-25d0905d4224 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:49.328541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60491ee-db44-47a9-8b10-7d0cfb8c87b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:49.329564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60491ee-db44-47a9-8b10-7d0cfb8c87b3 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:49.329851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60491ee-db44-47a9-8b10-7d0cfb8c87b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:49.330128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60491ee-db44-47a9-8b10-7d0cfb8c87b3 None admin] PATH_INFO: `/v3/users/234c439d30d64470997f2c02632db3e5` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:49.331412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60491ee-db44-47a9-8b10-7d0cfb8c87b3 None admin] RBAC: Authorizing `identity:get_user(user_id=234c439d30d64470997f2c02632db3e5)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:49.332878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60491ee-db44-47a9-8b10-7d0cfb8c87b3 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:49.334572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 177/360] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:36:49 2022] GET /identity/v3/users/234c439d30d64470997f2c02632db3e5 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:49.335438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60491ee-db44-47a9-8b10-7d0cfb8c87b3 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:49.359296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f1ce5-d090-482a-a22b-848e3e16db89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:49.359991 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1ce5-d090-482a-a22b-848e3e16db89 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:49.360278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1ce5-d090-482a-a22b-848e3e16db89 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:49.360558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f1ce5-d090-482a-a22b-848e3e16db89 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:49.362028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f1ce5-d090-482a-a22b-848e3e16db89 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:49.363305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f1ce5-d090-482a-a22b-848e3e16db89 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:49.364972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 184/361] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:49 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:49.365829 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f1ce5-d090-482a-a22b-848e3e16db89 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:49.383146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:49.436597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:49.475728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60491ee-db44-47a9-8b10-7d0cfb8c87b3 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:49.513651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f1ce5-d090-482a-a22b-848e3e16db89 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:49.527684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43ee4-4648-47d1-bba8-bd5ab73675cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:49.528520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43ee4-4648-47d1-bba8-bd5ab73675cf None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:49.528627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43ee4-4648-47d1-bba8-bd5ab73675cf None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:49.528893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b43ee4-4648-47d1-bba8-bd5ab73675cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:49.529748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b43ee4-4648-47d1-bba8-bd5ab73675cf None admin] RBAC: Adding query filter params (group.id=92de0b650c9a486ea54f79cae6543172, role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=e516b1510c304deca52090a8334ae8fd) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:49.530058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b43ee4-4648-47d1-bba8-bd5ab73675cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:49.533051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b43ee4-4648-47d1-bba8-bd5ab73675cf None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:49.539463 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 178/362] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:36:49 2022] GET /identity/v3/role_assignments?group.id=92de0b650c9a486ea54f79cae6543172&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:49.540592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43ee4-4648-47d1-bba8-bd5ab73675cf None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:49.581590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe787e-60ba-4080-8834-b5ec5d8376ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:49.582454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe787e-60ba-4080-8834-b5ec5d8376ed None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:49.582738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe787e-60ba-4080-8834-b5ec5d8376ed None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:49.583014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe787e-60ba-4080-8834-b5ec5d8376ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:49.597927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe787e-60ba-4080-8834-b5ec5d8376ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-9cfe787e-60ba-4080-8834-b5ec5d8376ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:49.608024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:49.609109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 185/363] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:49.609941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe787e-60ba-4080-8834-b5ec5d8376ed None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:49.702699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:49.710744 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b43ee4-4648-47d1-bba8-bd5ab73675cf None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:49.761306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665d34d-9f5e-40af-8084-57ef5cb68d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:49.761979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665d34d-9f5e-40af-8084-57ef5cb68d27 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:49.762265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665d34d-9f5e-40af-8084-57ef5cb68d27 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:49.762595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665d34d-9f5e-40af-8084-57ef5cb68d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:49.771502 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe787e-60ba-4080-8834-b5ec5d8376ed None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:49.784502 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:49.816960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdae414-71d0-40e5-a67b-765145f53a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:49.818349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdae414-71d0-40e5-a67b-765145f53a8e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:49.818349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdae414-71d0-40e5-a67b-765145f53a8e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:49.818349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdae414-71d0-40e5-a67b-765145f53a8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:49.830243 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdae414-71d0-40e5-a67b-765145f53a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-9fdae414-71d0-40e5-a67b-765145f53a8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:49.839563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:49.841693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 186/364] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:49.843383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdae414-71d0-40e5-a67b-765145f53a8e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:49.871184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665d34d-9f5e-40af-8084-57ef5cb68d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:49.872988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665d34d-9f5e-40af-8084-57ef5cb68d27 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:49.963511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdae414-71d0-40e5-a67b-765145f53a8e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:49.992159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:49.998647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 179/365] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:49.999546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665d34d-9f5e-40af-8084-57ef5cb68d27 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:50.008730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094bfa0-6238-48ad-a9b9-2ef9f640a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:50.011165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094bfa0-6238-48ad-a9b9-2ef9f640a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:50.012095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094bfa0-6238-48ad-a9b9-2ef9f640a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:50.012550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094bfa0-6238-48ad-a9b9-2ef9f640a9e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:50.014389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094bfa0-6238-48ad-a9b9-2ef9f640a9e1 None admin] RBAC: Adding query filter params (role.id=e3e665bc6a4749e99c8ae8d00deafb3a, user.id=234c439d30d64470997f2c02632db3e5, scope.system=all) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:50.014925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094bfa0-6238-48ad-a9b9-2ef9f640a9e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:50.017411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094bfa0-6238-48ad-a9b9-2ef9f640a9e1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:50.031841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 187/366] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jun 23 10:36:49 2022] GET /identity/v3/role_assignments?user.id=234c439d30d64470997f2c02632db3e5&scope.system=all&role.id=e3e665bc6a4749e99c8ae8d00deafb3a => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:50.032699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094bfa0-6238-48ad-a9b9-2ef9f640a9e1 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:50.070126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:50.152986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665d34d-9f5e-40af-8084-57ef5cb68d27 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:50.155041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094bfa0-6238-48ad-a9b9-2ef9f640a9e1 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:50.193499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dee997-3dfa-44ef-99c4-688db9cc147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:50.194181 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dee997-3dfa-44ef-99c4-688db9cc147a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:50.194505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dee997-3dfa-44ef-99c4-688db9cc147a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:50.194789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dee997-3dfa-44ef-99c4-688db9cc147a None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:50.195680 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dee997-3dfa-44ef-99c4-688db9cc147a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:50.196640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dee997-3dfa-44ef-99c4-688db9cc147a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:50.198215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dee997-3dfa-44ef-99c4-688db9cc147a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:50.206079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0ddc0-f30b-4194-8f04-cc25c844edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:50.207163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0ddc0-f30b-4194-8f04-cc25c844edfc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:50.207647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0ddc0-f30b-4194-8f04-cc25c844edfc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:50.208132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 188/367] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:50.208351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0ddc0-f30b-4194-8f04-cc25c844edfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:50.209010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dee997-3dfa-44ef-99c4-688db9cc147a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:50.209852 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0ddc0-f30b-4194-8f04-cc25c844edfc None admin] RBAC: Adding query filter params (group.id=92de0b650c9a486ea54f79cae6543172, role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=e516b1510c304deca52090a8334ae8fd) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:50.210404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0ddc0-f30b-4194-8f04-cc25c844edfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:50.213155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0ddc0-f30b-4194-8f04-cc25c844edfc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:50.223724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 180/368] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:36:49 2022] GET /identity/v3/role_assignments?group.id=92de0b650c9a486ea54f79cae6543172&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:50.224718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0ddc0-f30b-4194-8f04-cc25c844edfc None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:50.308366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:50.331987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:50.345259 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dee997-3dfa-44ef-99c4-688db9cc147a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:50.373535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0ddc0-f30b-4194-8f04-cc25c844edfc None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:50.389536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32d315-c230-47d1-87f0-2ae62834897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:50.390260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32d315-c230-47d1-87f0-2ae62834897b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:50.390568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32d315-c230-47d1-87f0-2ae62834897b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:50.390931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32d315-c230-47d1-87f0-2ae62834897b None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:50.391621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32d315-c230-47d1-87f0-2ae62834897b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:50.391933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32d315-c230-47d1-87f0-2ae62834897b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:50.393377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32d315-c230-47d1-87f0-2ae62834897b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:50.403979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 189/369] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:50.404612 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32d315-c230-47d1-87f0-2ae62834897b None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:50.424618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea3527-8a4c-4c51-b659-70f32f24aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:50.426033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea3527-8a4c-4c51-b659-70f32f24aca8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:50.426704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea3527-8a4c-4c51-b659-70f32f24aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:50.427192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea3527-8a4c-4c51-b659-70f32f24aca8 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:50.429073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea3527-8a4c-4c51-b659-70f32f24aca8 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:50.431968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea3527-8a4c-4c51-b659-70f32f24aca8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:50.435037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 181/370] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:50 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:50.436751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea3527-8a4c-4c51-b659-70f32f24aca8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:50.562856 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea3527-8a4c-4c51-b659-70f32f24aca8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:50.565712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32d315-c230-47d1-87f0-2ae62834897b None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:50.598798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:50.608379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41536f4-bc04-4f91-8145-29284e3fcd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:50.609680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41536f4-bc04-4f91-8145-29284e3fcd19 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:50.610202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41536f4-bc04-4f91-8145-29284e3fcd19 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:50.610723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41536f4-bc04-4f91-8145-29284e3fcd19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:50.624340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295ffba-b887-4733-b9b4-1d98698b79c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:50.625439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295ffba-b887-4733-b9b4-1d98698b79c0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:50.625895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295ffba-b887-4733-b9b4-1d98698b79c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:50.626569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295ffba-b887-4733-b9b4-1d98698b79c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:50.674055 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:50.699492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41536f4-bc04-4f91-8145-29284e3fcd19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:50.701893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41536f4-bc04-4f91-8145-29284e3fcd19 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:50.735537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295ffba-b887-4733-b9b4-1d98698b79c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:50.737006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295ffba-b887-4733-b9b4-1d98698b79c0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:50.850101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 182/371] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:50.851405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41536f4-bc04-4f91-8145-29284e3fcd19 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:50.874307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 190/372] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:50.875177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295ffba-b887-4733-b9b4-1d98698b79c0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:50.888022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:50.939149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:50.966496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41536f4-bc04-4f91-8145-29284e3fcd19 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:50.999924 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295ffba-b887-4733-b9b4-1d98698b79c0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:51.012860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c358b51-5055-4387-9e99-4dacd5608b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:51.014298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c358b51-5055-4387-9e99-4dacd5608b94 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:51.014948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c358b51-5055-4387-9e99-4dacd5608b94 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:51.015193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c358b51-5055-4387-9e99-4dacd5608b94 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:51.017094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c358b51-5055-4387-9e99-4dacd5608b94 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:51.019304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c358b51-5055-4387-9e99-4dacd5608b94 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:51.021728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 183/373] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:50 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:51.022366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c358b51-5055-4387-9e99-4dacd5608b94 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:51.051543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755593b-e59b-42ca-b2eb-268b7e5544f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:51.053049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755593b-e59b-42ca-b2eb-268b7e5544f5 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:51.053795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755593b-e59b-42ca-b2eb-268b7e5544f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:51.054791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755593b-e59b-42ca-b2eb-268b7e5544f5 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:51.057514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755593b-e59b-42ca-b2eb-268b7e5544f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:51.059905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755593b-e59b-42ca-b2eb-268b7e5544f5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:51.062725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 191/374] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:50 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:51.063765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755593b-e59b-42ca-b2eb-268b7e5544f5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:51.161708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:51.168531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c358b51-5055-4387-9e99-4dacd5608b94 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:51.200991 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755593b-e59b-42ca-b2eb-268b7e5544f5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:51.219873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffd645-f906-4bc1-8c5f-6048378be1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:51.221132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffd645-f906-4bc1-8c5f-6048378be1ba None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:51.221911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffd645-f906-4bc1-8c5f-6048378be1ba None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:51.222471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffd645-f906-4bc1-8c5f-6048378be1ba None admin] PATH_INFO: `/v3/projects/90bfbe3ca19640a8a67be01b638e500f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:51.224495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffd645-f906-4bc1-8c5f-6048378be1ba None admin] RBAC: Authorizing `identity:get_project(project_id=90bfbe3ca19640a8a67be01b638e500f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:51.226552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:51.228035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffd645-f906-4bc1-8c5f-6048378be1ba None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:51.230543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 184/375] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:51 2022] GET /identity/v3/projects/90bfbe3ca19640a8a67be01b638e500f => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:51.232329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffd645-f906-4bc1-8c5f-6048378be1ba None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:51.246193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04bf6-02d2-4fb5-90e5-8bcb59ebe7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:51.247344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04bf6-02d2-4fb5-90e5-8bcb59ebe7a6 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:51.247344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04bf6-02d2-4fb5-90e5-8bcb59ebe7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:51.247540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04bf6-02d2-4fb5-90e5-8bcb59ebe7a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:51.248402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b04bf6-02d2-4fb5-90e5-8bcb59ebe7a6 None admin] RBAC: Adding query filter params (group.id=92de0b650c9a486ea54f79cae6543172, role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=0f85f312c90640a8a492326b31767a81) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:51.248724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b04bf6-02d2-4fb5-90e5-8bcb59ebe7a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:51.252617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b04bf6-02d2-4fb5-90e5-8bcb59ebe7a6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:51.260873 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 192/376] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:36:51 2022] GET /identity/v3/role_assignments?group.id=92de0b650c9a486ea54f79cae6543172&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:51.261897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04bf6-02d2-4fb5-90e5-8bcb59ebe7a6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:51.374150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffd645-f906-4bc1-8c5f-6048378be1ba None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:51.408333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04bf6-02d2-4fb5-90e5-8bcb59ebe7a6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:51.420970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079f4c6-98d8-411f-b7fb-824783d27fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:51.421753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079f4c6-98d8-411f-b7fb-824783d27fa6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:51.422040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079f4c6-98d8-411f-b7fb-824783d27fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:51.422341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079f4c6-98d8-411f-b7fb-824783d27fa6 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:51.423573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079f4c6-98d8-411f-b7fb-824783d27fa6 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:51.425219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079f4c6-98d8-411f-b7fb-824783d27fa6 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:51.427061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 185/377] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:51 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:51.433277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079f4c6-98d8-411f-b7fb-824783d27fa6 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:51.456542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71565-0796-4c86-a960-62aa0d7cf50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:51.457797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71565-0796-4c86-a960-62aa0d7cf50a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:51.458299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71565-0796-4c86-a960-62aa0d7cf50a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:51.458819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a71565-0796-4c86-a960-62aa0d7cf50a None admin] PATH_INFO: `/v3/groups/af4457947c1d4ed6a9af81a670f7c3ec` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:51.468690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a71565-0796-4c86-a960-62aa0d7cf50a None admin] RBAC: Authorizing `identity:get_group(group_id=af4457947c1d4ed6a9af81a670f7c3ec)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:51.470758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a71565-0796-4c86-a960-62aa0d7cf50a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:51.473294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 193/378] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:51 2022] GET /identity/v3/groups/af4457947c1d4ed6a9af81a670f7c3ec => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:51.480210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71565-0796-4c86-a960-62aa0d7cf50a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:51.522869 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:51.580772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:51.618688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079f4c6-98d8-411f-b7fb-824783d27fa6 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:51.669591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a534b2-2726-4f95-8f7f-50d801e8f9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:51.670257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a534b2-2726-4f95-8f7f-50d801e8f9fd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:51.670579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a534b2-2726-4f95-8f7f-50d801e8f9fd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:51.670857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a534b2-2726-4f95-8f7f-50d801e8f9fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:51.671762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a534b2-2726-4f95-8f7f-50d801e8f9fd None admin] RBAC: Adding query filter params (group.id=92de0b650c9a486ea54f79cae6543172, role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=0f85f312c90640a8a492326b31767a81) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:51.672024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a534b2-2726-4f95-8f7f-50d801e8f9fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:51.673494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a534b2-2726-4f95-8f7f-50d801e8f9fd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:51.693155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 186/379] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:36:51 2022] GET /identity/v3/role_assignments?group.id=92de0b650c9a486ea54f79cae6543172&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:51.701634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a71565-0796-4c86-a960-62aa0d7cf50a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:51.751483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96548d69-ff67-43c8-97b7-5527180327a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:51.752166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548d69-ff67-43c8-97b7-5527180327a9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:51.752463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548d69-ff67-43c8-97b7-5527180327a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:51.752757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548d69-ff67-43c8-97b7-5527180327a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:51.753604 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96548d69-ff67-43c8-97b7-5527180327a9 None admin] RBAC: Adding query filter params (group.id=af4457947c1d4ed6a9af81a670f7c3ec, role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=90bfbe3ca19640a8a67be01b638e500f) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:51.753930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96548d69-ff67-43c8-97b7-5527180327a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:51.756586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96548d69-ff67-43c8-97b7-5527180327a9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:51.764747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 194/380] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:36:51 2022] GET /identity/v3/role_assignments?group.id=af4457947c1d4ed6a9af81a670f7c3ec&scope.project.id=90bfbe3ca19640a8a67be01b638e500f&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 260 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:52.012939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366fa5d-245c-4289-b588-e2055fefee02 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:52.013424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366fa5d-245c-4289-b588-e2055fefee02 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:52.013424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366fa5d-245c-4289-b588-e2055fefee02 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:52.015163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 187/381] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:52.020923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cad950-daf8-4393-a68f-88d5c8d01864 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:52.021406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cad950-daf8-4393-a68f-88d5c8d01864 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:52.021482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cad950-daf8-4393-a68f-88d5c8d01864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:52.039075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f1cad950-daf8-4393-a68f-88d5c8d01864 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:52.040340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f1cad950-daf8-4393-a68f-88d5c8d01864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:52.124289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 195/382] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:52.146874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366fa5d-245c-4289-b588-e2055fefee02 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:52.264953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366fa5d-245c-4289-b588-e2055fefee02 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:52.273036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:52.312299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f2ba0-b45b-4be1-8f8c-1f9bedd6bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:52.313113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f2ba0-b45b-4be1-8f8c-1f9bedd6bc14 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:52.314992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f2ba0-b45b-4be1-8f8c-1f9bedd6bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:52.315500 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f2ba0-b45b-4be1-8f8c-1f9bedd6bc14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:52.330630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f2ba0-b45b-4be1-8f8c-1f9bedd6bc14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-a67f2ba0-b45b-4be1-8f8c-1f9bedd6bc14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:52.339169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:52.340143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:52.340972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:52.343563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 188/383] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:52.355511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cad950-daf8-4393-a68f-88d5c8d01864 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:52.405127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:52.477185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cad950-daf8-4393-a68f-88d5c8d01864 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:52.522124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926a6e-1e6c-41ae-b152-e18da00fd914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:52.523196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926a6e-1e6c-41ae-b152-e18da00fd914 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:52.523703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926a6e-1e6c-41ae-b152-e18da00fd914 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:52.524238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926a6e-1e6c-41ae-b152-e18da00fd914 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:52.525329 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926a6e-1e6c-41ae-b152-e18da00fd914 None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:52.525840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926a6e-1e6c-41ae-b152-e18da00fd914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:52.527466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926a6e-1e6c-41ae-b152-e18da00fd914 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:52.546409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 196/384] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:52.550256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f2ba0-b45b-4be1-8f8c-1f9bedd6bc14 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:52.705585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f2ba0-b45b-4be1-8f8c-1f9bedd6bc14 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:52.719828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446bdb-b0f6-412d-9fd7-3c8864c23b30 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:52.720204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446bdb-b0f6-412d-9fd7-3c8864c23b30 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:52.720406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446bdb-b0f6-412d-9fd7-3c8864c23b30 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:52.722756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 197/385] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:52.728541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca758135-2ddd-46a0-9393-6c3c491a8ac7 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:52.728959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca758135-2ddd-46a0-9393-6c3c491a8ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:52.729486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca758135-2ddd-46a0-9393-6c3c491a8ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:52.755524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ca758135-2ddd-46a0-9393-6c3c491a8ac7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:52.757446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ca758135-2ddd-46a0-9393-6c3c491a8ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:52.767767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d3d4a-7bab-4069-93eb-8bbcfe628b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:52.768656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d3d4a-7bab-4069-93eb-8bbcfe628b81 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:52.768941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d3d4a-7bab-4069-93eb-8bbcfe628b81 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:52.769222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d3d4a-7bab-4069-93eb-8bbcfe628b81 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:52.770481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d3d4a-7bab-4069-93eb-8bbcfe628b81 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:52.771950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d3d4a-7bab-4069-93eb-8bbcfe628b81 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:52.774034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 189/386] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:52 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:52.781234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d3d4a-7bab-4069-93eb-8bbcfe628b81 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:52.828980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:52.869712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 198/387] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:52.916319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca758135-2ddd-46a0-9393-6c3c491a8ac7 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:52.924739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d3d4a-7bab-4069-93eb-8bbcfe628b81 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:52.962231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d470-9791-4f35-8ba8-733cc9def0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:52.963516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d470-9791-4f35-8ba8-733cc9def0e8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:52.964008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d470-9791-4f35-8ba8-733cc9def0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:52.964486 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d470-9791-4f35-8ba8-733cc9def0e8 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:52.965989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9d470-9791-4f35-8ba8-733cc9def0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:52.967859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9d470-9791-4f35-8ba8-733cc9def0e8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:52.970207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 190/388] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:52 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:52.976288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d470-9791-4f35-8ba8-733cc9def0e8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:52.993587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:53.080734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca758135-2ddd-46a0-9393-6c3c491a8ac7 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:53.106260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:53.122247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d470-9791-4f35-8ba8-733cc9def0e8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:53.143096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44783369-6327-46bf-9e1d-ce05a93e9c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:53.144006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44783369-6327-46bf-9e1d-ce05a93e9c35 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:53.144509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44783369-6327-46bf-9e1d-ce05a93e9c35 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:53.145009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44783369-6327-46bf-9e1d-ce05a93e9c35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:53.166772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29091ab2-204d-44fa-8c22-cc5df7260e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:53.167661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29091ab2-204d-44fa-8c22-cc5df7260e73 None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:53.167948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29091ab2-204d-44fa-8c22-cc5df7260e73 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:53.168233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29091ab2-204d-44fa-8c22-cc5df7260e73 None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd/groups/92de0b650c9a486ea54f79cae6543172/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:53.170357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44783369-6327-46bf-9e1d-ce05a93e9c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-44783369-6327-46bf-9e1d-ce05a93e9c35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:53.178655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:53.179563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:53.182583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:53.184028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29091ab2-204d-44fa-8c22-cc5df7260e73 None admin] RBAC: Authorizing `identity:create_grant(project_id=e516b1510c304deca52090a8334ae8fd, group_id=92de0b650c9a486ea54f79cae6543172, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:53.184028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29091ab2-204d-44fa-8c22-cc5df7260e73 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:53.187718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 199/389] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:53.188984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44783369-6327-46bf-9e1d-ce05a93e9c35 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:53.200792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 191/390] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 23 10:36:52 2022] PUT /identity/v3/projects/e516b1510c304deca52090a8334ae8fd/groups/92de0b650c9a486ea54f79cae6543172/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:53.362804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:53.376350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44783369-6327-46bf-9e1d-ce05a93e9c35 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:53.433131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3020911-4f6f-41c3-b9e8-ab409065f307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:53.433808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3020911-4f6f-41c3-b9e8-ab409065f307 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:53.434092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3020911-4f6f-41c3-b9e8-ab409065f307 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:53.434403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3020911-4f6f-41c3-b9e8-ab409065f307 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:53.435165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3020911-4f6f-41c3-b9e8-ab409065f307 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:53.435477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3020911-4f6f-41c3-b9e8-ab409065f307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:53.436878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3020911-4f6f-41c3-b9e8-ab409065f307 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:53.447627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 200/391] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:53.453114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29091ab2-204d-44fa-8c22-cc5df7260e73 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:53.585692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29091ab2-204d-44fa-8c22-cc5df7260e73 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:53.622849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7b7ce-86a3-4064-9214-566330267a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:53.623636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7b7ce-86a3-4064-9214-566330267a58 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:53.623925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7b7ce-86a3-4064-9214-566330267a58 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:53.624209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7b7ce-86a3-4064-9214-566330267a58 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:53.625426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7b7ce-86a3-4064-9214-566330267a58 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:53.626933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7b7ce-86a3-4064-9214-566330267a58 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:53.628902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 192/392] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:53 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:53.635245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3020911-4f6f-41c3-b9e8-ab409065f307 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:53.757964 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3020911-4f6f-41c3-b9e8-ab409065f307 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:53.803025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb1664-c6eb-40fb-852c-6d5fd371877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:53.804279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb1664-c6eb-40fb-852c-6d5fd371877b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:53.804756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb1664-c6eb-40fb-852c-6d5fd371877b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:53.805979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb1664-c6eb-40fb-852c-6d5fd371877b None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:53.811571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb1664-c6eb-40fb-852c-6d5fd371877b None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:53.814362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb1664-c6eb-40fb-852c-6d5fd371877b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:53.817200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 201/393] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:53 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:53.825165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7b7ce-86a3-4064-9214-566330267a58 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:53.890378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:54.097037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7b7ce-86a3-4064-9214-566330267a58 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:54.177196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a376fa-087a-48e9-be4a-66cbadb52f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:54.178884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a376fa-087a-48e9-be4a-66cbadb52f5a None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:54.179363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a376fa-087a-48e9-be4a-66cbadb52f5a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:54.179874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a376fa-087a-48e9-be4a-66cbadb52f5a None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd/groups/92de0b650c9a486ea54f79cae6543172/roles/5e9864ab3b774da195d4d0b7282074ab` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:54.188330 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a376fa-087a-48e9-be4a-66cbadb52f5a None admin] RBAC: Authorizing `identity:create_grant(project_id=e516b1510c304deca52090a8334ae8fd, group_id=92de0b650c9a486ea54f79cae6543172, role_id=5e9864ab3b774da195d4d0b7282074ab)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:54.190385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a376fa-087a-48e9-be4a-66cbadb52f5a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:54.232403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 193/394] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 23 10:36:53 2022] PUT /identity/v3/projects/e516b1510c304deca52090a8334ae8fd/groups/92de0b650c9a486ea54f79cae6543172/roles/5e9864ab3b774da195d4d0b7282074ab => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:54.294685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416a87e-26ca-4a70-970c-0af345d9da06 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:54.295678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416a87e-26ca-4a70-970c-0af345d9da06 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:54.296155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416a87e-26ca-4a70-970c-0af345d9da06 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:54.298096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 202/395] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:54.304336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476333c-bb09-4bd3-94d9-2c9921f0a55f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:54.304939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476333c-bb09-4bd3-94d9-2c9921f0a55f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:54.305534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476333c-bb09-4bd3-94d9-2c9921f0a55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:54.339478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-9476333c-bb09-4bd3-94d9-2c9921f0a55f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:54.341071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9476333c-bb09-4bd3-94d9-2c9921f0a55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:54.480754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 194/396] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:54.521059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416a87e-26ca-4a70-970c-0af345d9da06 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:54.570903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:54.734502 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416a87e-26ca-4a70-970c-0af345d9da06 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:54.762376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4fd07-ac37-4696-8679-e0683d985ae9 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:54.762687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4fd07-ac37-4696-8679-e0683d985ae9 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:54.762952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4fd07-ac37-4696-8679-e0683d985ae9 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:54.764712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 195/397] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:54.771342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38174af-ad66-4cc0-bb50-1da11ccabff2 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:54.771627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38174af-ad66-4cc0-bb50-1da11ccabff2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:54.771911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38174af-ad66-4cc0-bb50-1da11ccabff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:54.797173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e38174af-ad66-4cc0-bb50-1da11ccabff2 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:54.798446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e38174af-ad66-4cc0-bb50-1da11ccabff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:54.807160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a18577-cba1-48f9-a501-a583d7a88fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:54.807972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a18577-cba1-48f9-a501-a583d7a88fba None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:54.808259 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a18577-cba1-48f9-a501-a583d7a88fba None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:54.808541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a18577-cba1-48f9-a501-a583d7a88fba None admin] PATH_INFO: `/v3/roles/member` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:54.816566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:54.830273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a18577-cba1-48f9-a501-a583d7a88fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-61a18577-cba1-48f9-a501-a583d7a88fba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:54.844427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:54.845383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:54.846173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:54.851073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 203/398] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:54.859381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a18577-cba1-48f9-a501-a583d7a88fba None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:54.920586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 196/399] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:54.921746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355042cf-5bbd-4d73-a226-d97ad09e22b8 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:54.922035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355042cf-5bbd-4d73-a226-d97ad09e22b8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:54.922329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355042cf-5bbd-4d73-a226-d97ad09e22b8 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:54.933018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 197/400] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:54.939093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159f487-cc3e-435b-b84e-e3dfba68911f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:54.939384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159f487-cc3e-435b-b84e-e3dfba68911f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:54.939934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159f487-cc3e-435b-b84e-e3dfba68911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:54.957873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c159f487-cc3e-435b-b84e-e3dfba68911f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:54.959100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c159f487-cc3e-435b-b84e-e3dfba68911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:54.975258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:54.996346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a18577-cba1-48f9-a501-a583d7a88fba None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:55.043460 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 198/401] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:55.046150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159f487-cc3e-435b-b84e-e3dfba68911f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.053687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589282df-d25a-4f1d-bbd9-4e46a254eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:55.054684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589282df-d25a-4f1d-bbd9-4e46a254eaeb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.055705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589282df-d25a-4f1d-bbd9-4e46a254eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.056375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589282df-d25a-4f1d-bbd9-4e46a254eaeb None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.059135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589282df-d25a-4f1d-bbd9-4e46a254eaeb None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:55.060783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589282df-d25a-4f1d-bbd9-4e46a254eaeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:55.062472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589282df-d25a-4f1d-bbd9-4e46a254eaeb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:55.077342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 204/402] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:55.078482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589282df-d25a-4f1d-bbd9-4e46a254eaeb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.141013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:55.175413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159f487-cc3e-435b-b84e-e3dfba68911f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:55.201730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589282df-d25a-4f1d-bbd9-4e46a254eaeb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:55.217224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a53e-b9af-460f-be7a-78a4ef800bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:55.218210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a53e-b9af-460f-be7a-78a4ef800bc6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.219077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a53e-b9af-460f-be7a-78a4ef800bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.219535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a53e-b9af-460f-be7a-78a4ef800bc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.232393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122a53e-b9af-460f-be7a-78a4ef800bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-f122a53e-b9af-460f-be7a-78a4ef800bc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:55.241038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:55.241993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:55.242897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:55.243524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a475ad-0fe2-41d1-a3f5-3fcaf7e90948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:55.244363 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a475ad-0fe2-41d1-a3f5-3fcaf7e90948 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.244714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a475ad-0fe2-41d1-a3f5-3fcaf7e90948 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.245059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a475ad-0fe2-41d1-a3f5-3fcaf7e90948 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.246340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 199/403] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:55.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a53e-b9af-460f-be7a-78a4ef800bc6 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.261698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a475ad-0fe2-41d1-a3f5-3fcaf7e90948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-f4a475ad-0fe2-41d1-a3f5-3fcaf7e90948 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:55.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:55.270479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:55.271281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 205/404] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:55.271984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a475ad-0fe2-41d1-a3f5-3fcaf7e90948 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.283436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:55.388598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a475ad-0fe2-41d1-a3f5-3fcaf7e90948 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:55.391773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a53e-b9af-460f-be7a-78a4ef800bc6 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:55.432401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:55.438854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f54bbc-92da-4472-b666-b5505498ad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:55.439980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54bbc-92da-4472-b666-b5505498ad37 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.440270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54bbc-92da-4472-b666-b5505498ad37 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.440554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54bbc-92da-4472-b666-b5505498ad37 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.441795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f54bbc-92da-4472-b666-b5505498ad37 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:55.443359 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f54bbc-92da-4472-b666-b5505498ad37 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:55.443971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a73e08-5f21-497b-a203-c01114d8e160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:55.444842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a73e08-5f21-497b-a203-c01114d8e160 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.445317 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a73e08-5f21-497b-a203-c01114d8e160 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.445518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 200/405] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:55 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:55.446239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a73e08-5f21-497b-a203-c01114d8e160 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.446434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f54bbc-92da-4472-b666-b5505498ad37 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.447879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a73e08-5f21-497b-a203-c01114d8e160 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:55.448497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a73e08-5f21-497b-a203-c01114d8e160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:55.450522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a73e08-5f21-497b-a203-c01114d8e160 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:55.462826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 206/406] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:55.464568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a73e08-5f21-497b-a203-c01114d8e160 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.557164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:55.591399 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f54bbc-92da-4472-b666-b5505498ad37 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:55.607813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a73e08-5f21-497b-a203-c01114d8e160 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:55.636254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d3313-39b1-4dd7-9a2c-205228483a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:55.637034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d3313-39b1-4dd7-9a2c-205228483a2d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.637345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d3313-39b1-4dd7-9a2c-205228483a2d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.637629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d3313-39b1-4dd7-9a2c-205228483a2d None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.638788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d3313-39b1-4dd7-9a2c-205228483a2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:55.639140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d3313-39b1-4dd7-9a2c-205228483a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:55.641099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d3313-39b1-4dd7-9a2c-205228483a2d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:55.649266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe77b7-0b4c-43ff-84bb-84f799d50fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:55.650398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe77b7-0b4c-43ff-84bb-84f799d50fc1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.650828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe77b7-0b4c-43ff-84bb-84f799d50fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.651271 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe77b7-0b4c-43ff-84bb-84f799d50fc1 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.652695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe77b7-0b4c-43ff-84bb-84f799d50fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:55.654403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe77b7-0b4c-43ff-84bb-84f799d50fc1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:55.656308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 207/407] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:55 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:55.657243 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe77b7-0b4c-43ff-84bb-84f799d50fc1 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.657393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 201/408] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:55.661864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d3313-39b1-4dd7-9a2c-205228483a2d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.735203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:55.775214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe77b7-0b4c-43ff-84bb-84f799d50fc1 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:55.786858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d3313-39b1-4dd7-9a2c-205228483a2d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:55.813468 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fcf59-4028-4f2e-bd3b-0e8bf8f00953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:55.814522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fcf59-4028-4f2e-bd3b-0e8bf8f00953 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.814941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fcf59-4028-4f2e-bd3b-0e8bf8f00953 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.815122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fcf59-4028-4f2e-bd3b-0e8bf8f00953 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.816804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fcf59-4028-4f2e-bd3b-0e8bf8f00953 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:55.818084 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fcf59-4028-4f2e-bd3b-0e8bf8f00953 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:55.820007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 208/409] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:55 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:55.820546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fcf59-4028-4f2e-bd3b-0e8bf8f00953 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.828316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:55.835293 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a4276-6e75-4467-86c5-f5c438cfd046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:55.836182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a4276-6e75-4467-86c5-f5c438cfd046 None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.836566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a4276-6e75-4467-86c5-f5c438cfd046 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.836853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a4276-6e75-4467-86c5-f5c438cfd046 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81/groups/92de0b650c9a486ea54f79cae6543172/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.839558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a4276-6e75-4467-86c5-f5c438cfd046 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f85f312c90640a8a492326b31767a81, group_id=92de0b650c9a486ea54f79cae6543172, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:55.841009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a4276-6e75-4467-86c5-f5c438cfd046 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:55.856028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 202/410] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 23 10:36:55 2022] PUT /identity/v3/projects/0f85f312c90640a8a492326b31767a81/groups/92de0b650c9a486ea54f79cae6543172/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:36:55.857703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a833f6-b60e-4290-9801-b2b9895fadb7 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:55.858215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a833f6-b60e-4290-9801-b2b9895fadb7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:55.858727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a833f6-b60e-4290-9801-b2b9895fadb7 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:55.860276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 203/411] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:55.861255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a833f6-b60e-4290-9801-b2b9895fadb7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:55.970148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fcf59-4028-4f2e-bd3b-0e8bf8f00953 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:56.005736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a833f6-b60e-4290-9801-b2b9895fadb7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:56.019761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73403b45-fac3-48b2-a323-86c3e6695e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:56.019964 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73403b45-fac3-48b2-a323-86c3e6695e1a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.020145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73403b45-fac3-48b2-a323-86c3e6695e1a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.020489 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73403b45-fac3-48b2-a323-86c3e6695e1a None admin] PATH_INFO: `/v3/groups/af4457947c1d4ed6a9af81a670f7c3ec` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.021779 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73403b45-fac3-48b2-a323-86c3e6695e1a None admin] RBAC: Authorizing `identity:get_group(group_id=af4457947c1d4ed6a9af81a670f7c3ec)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:56.023177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73403b45-fac3-48b2-a323-86c3e6695e1a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:56.029723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 209/412] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:55 2022] GET /identity/v3/groups/af4457947c1d4ed6a9af81a670f7c3ec => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:56.029723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a0f81-afbc-4702-9568-a3f1b0054034 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.029723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a0f81-afbc-4702-9568-a3f1b0054034 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.029723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a0f81-afbc-4702-9568-a3f1b0054034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.047393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:56.057594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63941dc2-3fdf-4a55-ac1f-594dd5f11ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:56.062495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63941dc2-3fdf-4a55-ac1f-594dd5f11ae7 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.062495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63941dc2-3fdf-4a55-ac1f-594dd5f11ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.062495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63941dc2-3fdf-4a55-ac1f-594dd5f11ae7 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.063441 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63941dc2-3fdf-4a55-ac1f-594dd5f11ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:56.063585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ed9a0f81-afbc-4702-9568-a3f1b0054034 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:56.064945 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ed9a0f81-afbc-4702-9568-a3f1b0054034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:56.065647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63941dc2-3fdf-4a55-ac1f-594dd5f11ae7 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:56.067782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 204/413] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:55 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:56.069608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63941dc2-3fdf-4a55-ac1f-594dd5f11ae7 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:56.145225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 210/414] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:56.146278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a0f81-afbc-4702-9568-a3f1b0054034 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:56.148973 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:56.229928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63941dc2-3fdf-4a55-ac1f-594dd5f11ae7 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:56.273514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d63e75-55e1-4237-9984-dd8aeef746ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:56.274612 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a0f81-afbc-4702-9568-a3f1b0054034 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:56.275417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d63e75-55e1-4237-9984-dd8aeef746ef None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.275863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d63e75-55e1-4237-9984-dd8aeef746ef None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.276276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d63e75-55e1-4237-9984-dd8aeef746ef None admin] PATH_INFO: `/v3/projects/90bfbe3ca19640a8a67be01b638e500f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.278944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d63e75-55e1-4237-9984-dd8aeef746ef None admin] RBAC: Authorizing `identity:get_project(project_id=90bfbe3ca19640a8a67be01b638e500f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:56.284750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d63e75-55e1-4237-9984-dd8aeef746ef None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:56.287524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 205/415] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:56 2022] GET /identity/v3/projects/90bfbe3ca19640a8a67be01b638e500f => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:56.288536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d63e75-55e1-4237-9984-dd8aeef746ef None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:56.316431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efb889-cde5-4b19-b224-1bdb44ff7cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:56.317736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efb889-cde5-4b19-b224-1bdb44ff7cb8 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.318212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efb889-cde5-4b19-b224-1bdb44ff7cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.318722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efb889-cde5-4b19-b224-1bdb44ff7cb8 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81/groups/92de0b650c9a486ea54f79cae6543172/roles/5e9864ab3b774da195d4d0b7282074ab` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.322014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efb889-cde5-4b19-b224-1bdb44ff7cb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f85f312c90640a8a492326b31767a81, group_id=92de0b650c9a486ea54f79cae6543172, role_id=5e9864ab3b774da195d4d0b7282074ab)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:56.323949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efb889-cde5-4b19-b224-1bdb44ff7cb8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:56.340212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 211/416] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 23 10:36:56 2022] PUT /identity/v3/projects/0f85f312c90640a8a492326b31767a81/groups/92de0b650c9a486ea54f79cae6543172/roles/5e9864ab3b774da195d4d0b7282074ab => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:56.341889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efb889-cde5-4b19-b224-1bdb44ff7cb8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:56.399603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:56.485338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d63e75-55e1-4237-9984-dd8aeef746ef None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:56.499900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:56.561290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d267ec-71c0-41cd-8b7a-c407435e3388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:56.562094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d267ec-71c0-41cd-8b7a-c407435e3388 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.562415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d267ec-71c0-41cd-8b7a-c407435e3388 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.562744 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d267ec-71c0-41cd-8b7a-c407435e3388 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.565497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efb889-cde5-4b19-b224-1bdb44ff7cb8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:56.578125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d267ec-71c0-41cd-8b7a-c407435e3388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-41d267ec-71c0-41cd-8b7a-c407435e3388 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:56.588197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:56.589156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:56.589996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:56.590826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 206/417] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:56.596552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d267ec-71c0-41cd-8b7a-c407435e3388 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:56.630915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a38af-edb1-464e-980f-cff6aedfab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:56.631917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a38af-edb1-464e-980f-cff6aedfab2a None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.632306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a38af-edb1-464e-980f-cff6aedfab2a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.632579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a38af-edb1-464e-980f-cff6aedfab2a None admin] PATH_INFO: `/v3/projects/90bfbe3ca19640a8a67be01b638e500f/groups/af4457947c1d4ed6a9af81a670f7c3ec/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.635852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a38af-edb1-464e-980f-cff6aedfab2a None admin] RBAC: Authorizing `identity:create_grant(project_id=90bfbe3ca19640a8a67be01b638e500f, group_id=af4457947c1d4ed6a9af81a670f7c3ec, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:56.637851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a38af-edb1-464e-980f-cff6aedfab2a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:56.662020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 212/418] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jun 23 10:36:56 2022] PUT /identity/v3/projects/90bfbe3ca19640a8a67be01b638e500f/groups/af4457947c1d4ed6a9af81a670f7c3ec/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:36:56.751426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d267ec-71c0-41cd-8b7a-c407435e3388 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:56.781842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:56.808114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951f1c8-b181-4a26-8c3c-11af83b30f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:56.808806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951f1c8-b181-4a26-8c3c-11af83b30f80 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.809214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951f1c8-b181-4a26-8c3c-11af83b30f80 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.809505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951f1c8-b181-4a26-8c3c-11af83b30f80 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.810346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951f1c8-b181-4a26-8c3c-11af83b30f80 None admin] RBAC: Adding query filter params (name=member) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:56.810683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951f1c8-b181-4a26-8c3c-11af83b30f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:56.812221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951f1c8-b181-4a26-8c3c-11af83b30f80 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:56.827870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 207/419] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:56.833966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a38af-edb1-464e-980f-cff6aedfab2a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:56.956983 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a38af-edb1-464e-980f-cff6aedfab2a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:56.969144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9905f1a-4d8d-4180-8a5f-89848d03f66e None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.969450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9905f1a-4d8d-4180-8a5f-89848d03f66e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.969936 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9905f1a-4d8d-4180-8a5f-89848d03f66e None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.971639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 208/420] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:56.976585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db858a3-dcfe-428a-85e6-f7186a552f42 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:56.976873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db858a3-dcfe-428a-85e6-f7186a552f42 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:56.977926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db858a3-dcfe-428a-85e6-f7186a552f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:56.985544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:57.002307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-7db858a3-dcfe-428a-85e6-f7186a552f42 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:57.002552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa458f-0916-4d01-b201-650842b718ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:57.003085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa458f-0916-4d01-b201-650842b718ea None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:57.003371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa458f-0916-4d01-b201-650842b718ea None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:57.003655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa458f-0916-4d01-b201-650842b718ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:57.004372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7db858a3-dcfe-428a-85e6-f7186a552f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:57.140410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 209/421] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:57.161798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa458f-0916-4d01-b201-650842b718ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:57.163536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa458f-0916-4d01-b201-650842b718ea None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:57.202279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db858a3-dcfe-428a-85e6-f7186a552f42 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:57.345808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 213/422] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:57.353745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa458f-0916-4d01-b201-650842b718ea None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:57.355882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db858a3-dcfe-428a-85e6-f7186a552f42 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:57.382788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:57.397715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd9add-5980-4581-8b31-9d50f6263334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:57.401287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd9add-5980-4581-8b31-9d50f6263334 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:57.401822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd9add-5980-4581-8b31-9d50f6263334 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:57.402796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd9add-5980-4581-8b31-9d50f6263334 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:57.408192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:57.434133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd9add-5980-4581-8b31-9d50f6263334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-d1fd9add-5980-4581-8b31-9d50f6263334 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:57.453071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:57.454018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:57.454853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:36:57.458470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 210/423] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:57.466844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd9add-5980-4581-8b31-9d50f6263334 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:57.495063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa458f-0916-4d01-b201-650842b718ea None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:57.566537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914c4ae-872f-489c-9f48-9359755846dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:57.568222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914c4ae-872f-489c-9f48-9359755846dd None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:57.568733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914c4ae-872f-489c-9f48-9359755846dd None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:57.569207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914c4ae-872f-489c-9f48-9359755846dd None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:57.571740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914c4ae-872f-489c-9f48-9359755846dd None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:57.575105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914c4ae-872f-489c-9f48-9359755846dd None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:57.579556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 214/424] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:57 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:57.587876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914c4ae-872f-489c-9f48-9359755846dd None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:57.610346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd9add-5980-4581-8b31-9d50f6263334 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:57.643428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd6fd5-6d2a-4d4b-8fc1-ea4301ab79a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:57.643772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd6fd5-6d2a-4d4b-8fc1-ea4301ab79a9 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:57.646339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd6fd5-6d2a-4d4b-8fc1-ea4301ab79a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:57.646339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd6fd5-6d2a-4d4b-8fc1-ea4301ab79a9 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:57.646339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd6fd5-6d2a-4d4b-8fc1-ea4301ab79a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:57.646339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd6fd5-6d2a-4d4b-8fc1-ea4301ab79a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:57.650220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd6fd5-6d2a-4d4b-8fc1-ea4301ab79a9 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:57.671624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 211/425] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:57.678634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd6fd5-6d2a-4d4b-8fc1-ea4301ab79a9 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:57.747793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:57.801270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:57.826964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd6fd5-6d2a-4d4b-8fc1-ea4301ab79a9 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:57.837059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914c4ae-872f-489c-9f48-9359755846dd None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:57.862943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2992f9a-d945-44f4-9a7a-f5810ac87bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:57.863592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992f9a-d945-44f4-9a7a-f5810ac87bd6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:57.863878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992f9a-d945-44f4-9a7a-f5810ac87bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:57.864159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992f9a-d945-44f4-9a7a-f5810ac87bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:57.936252 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2992f9a-d945-44f4-9a7a-f5810ac87bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:57.937526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2992f9a-d945-44f4-9a7a-f5810ac87bd6 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:57.943010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072d52b-c105-4955-90bb-c87fe8dcbc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:57.943880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072d52b-c105-4955-90bb-c87fe8dcbc24 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:57.944164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072d52b-c105-4955-90bb-c87fe8dcbc24 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:57.944441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072d52b-c105-4955-90bb-c87fe8dcbc24 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:57.951128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072d52b-c105-4955-90bb-c87fe8dcbc24 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:57.952617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072d52b-c105-4955-90bb-c87fe8dcbc24 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:57.954657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 215/426] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:57 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:57.972400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072d52b-c105-4955-90bb-c87fe8dcbc24 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:57.974268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:58.046507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 212/427] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:36:58.052712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2992f9a-d945-44f4-9a7a-f5810ac87bd6 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:58.200686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072d52b-c105-4955-90bb-c87fe8dcbc24 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:58.225329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2992f9a-d945-44f4-9a7a-f5810ac87bd6 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:58.239565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4598553-2a7b-4afd-87b9-cfbe33083f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:58.240474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598553-2a7b-4afd-87b9-cfbe33083f93 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.240907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598553-2a7b-4afd-87b9-cfbe33083f93 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.241340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4598553-2a7b-4afd-87b9-cfbe33083f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.242344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598553-2a7b-4afd-87b9-cfbe33083f93 None admin] RBAC: Adding query filter params (group.id=92de0b650c9a486ea54f79cae6543172, role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=e516b1510c304deca52090a8334ae8fd) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:58.243412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598553-2a7b-4afd-87b9-cfbe33083f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:58.245023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4598553-2a7b-4afd-87b9-cfbe33083f93 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:58.251867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 216/428] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:36:57 2022] GET /identity/v3/role_assignments?group.id=92de0b650c9a486ea54f79cae6543172&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 611 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:58.253362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb5d0-0969-41e1-86a0-6fffd3135941 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.253799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb5d0-0969-41e1-86a0-6fffd3135941 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.254222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bb5d0-0969-41e1-86a0-6fffd3135941 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.255755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 217/429] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:58.263214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ec2e3-cde4-40dc-b64c-4db8d28cfb50 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.263396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:58.263869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ec2e3-cde4-40dc-b64c-4db8d28cfb50 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.264381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ec2e3-cde4-40dc-b64c-4db8d28cfb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.271561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb9ce-0973-4d42-8640-764bb037f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:58.272740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb9ce-0973-4d42-8640-764bb037f8ee None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.273163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb9ce-0973-4d42-8640-764bb037f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.273577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fb9ce-0973-4d42-8640-764bb037f8ee None admin] PATH_INFO: `/v3/projects/e516b1510c304deca52090a8334ae8fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.275790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb9ce-0973-4d42-8640-764bb037f8ee None admin] RBAC: Authorizing `identity:get_project(project_id=e516b1510c304deca52090a8334ae8fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:58.277461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fb9ce-0973-4d42-8640-764bb037f8ee None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:58.280822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 213/430] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:58 2022] GET /identity/v3/projects/e516b1510c304deca52090a8334ae8fd => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:58.286776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb9ce-0973-4d42-8640-764bb037f8ee None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:58.287655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-161ec2e3-cde4-40dc-b64c-4db8d28cfb50 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:58.289183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-161ec2e3-cde4-40dc-b64c-4db8d28cfb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:58.312435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:58.371666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 218/431] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:58.412106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ec2e3-cde4-40dc-b64c-4db8d28cfb50 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:58.436189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fb9ce-0973-4d42-8640-764bb037f8ee None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:58.492219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413da594-036d-4e74-840f-8161c3aee95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:58.493891 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413da594-036d-4e74-840f-8161c3aee95d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.494270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413da594-036d-4e74-840f-8161c3aee95d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.494575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413da594-036d-4e74-840f-8161c3aee95d None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.495860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413da594-036d-4e74-840f-8161c3aee95d None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:58.497260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413da594-036d-4e74-840f-8161c3aee95d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:58.506864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 214/432] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:58 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:58.513719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413da594-036d-4e74-840f-8161c3aee95d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:58.548588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ec2e3-cde4-40dc-b64c-4db8d28cfb50 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:58.593236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba7968-63d2-4210-af54-edc750cf77d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:58.594036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba7968-63d2-4210-af54-edc750cf77d0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.594336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba7968-63d2-4210-af54-edc750cf77d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.594618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba7968-63d2-4210-af54-edc750cf77d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.608294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba7968-63d2-4210-af54-edc750cf77d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:58.610568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-45ba7968-63d2-4210-af54-edc750cf77d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:58.619629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:58.620581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:58.621401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 219/433] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:58.628308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba7968-63d2-4210-af54-edc750cf77d0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:58.655422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:58.657646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413da594-036d-4e74-840f-8161c3aee95d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:58.704810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21e24d-b494-4093-ac8d-61f9502bc7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:58.706048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21e24d-b494-4093-ac8d-61f9502bc7f4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.706543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21e24d-b494-4093-ac8d-61f9502bc7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.707128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21e24d-b494-4093-ac8d-61f9502bc7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.708505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21e24d-b494-4093-ac8d-61f9502bc7f4 None admin] RBAC: Adding query filter params (group.id=92de0b650c9a486ea54f79cae6543172, role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=e516b1510c304deca52090a8334ae8fd) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:58.709286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21e24d-b494-4093-ac8d-61f9502bc7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:58.712019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21e24d-b494-4093-ac8d-61f9502bc7f4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:58.721237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 215/434] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:36:58 2022] GET /identity/v3/role_assignments?group.id=92de0b650c9a486ea54f79cae6543172&scope.project.id=e516b1510c304deca52090a8334ae8fd&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:36:58.759207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba7968-63d2-4210-af54-edc750cf77d0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:58.811389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e90b7d-71ff-4a2e-97cb-977ea7201b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:58.812082 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e90b7d-71ff-4a2e-97cb-977ea7201b4d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.812367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e90b7d-71ff-4a2e-97cb-977ea7201b4d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.812649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e90b7d-71ff-4a2e-97cb-977ea7201b4d None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.813420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e90b7d-71ff-4a2e-97cb-977ea7201b4d None admin] RBAC: Adding query filter params (name=member) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:58.813734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e90b7d-71ff-4a2e-97cb-977ea7201b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:58.815530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e90b7d-71ff-4a2e-97cb-977ea7201b4d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:58.828632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 220/435] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:36:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:58.834112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21e24d-b494-4093-ac8d-61f9502bc7f4 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:58.901920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a57d7-5952-46e9-ab26-b42d40acee44 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.902261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a57d7-5952-46e9-ab26-b42d40acee44 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.902520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a57d7-5952-46e9-ab26-b42d40acee44 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.904021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 221/436] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:36:58.909605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97744c-4ee6-4da0-9e56-35ca17c6c06f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:58.910367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97744c-4ee6-4da0-9e56-35ca17c6c06f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:58.910943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97744c-4ee6-4da0-9e56-35ca17c6c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:58.932705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-eb97744c-4ee6-4da0-9e56-35ca17c6c06f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:58.934263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-eb97744c-4ee6-4da0-9e56-35ca17c6c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:58.970473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21e24d-b494-4093-ac8d-61f9502bc7f4 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:59.019534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:59.029194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1256b02-5fde-4bc1-94cc-e866f0beb64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:59.030264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256b02-5fde-4bc1-94cc-e866f0beb64b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.031620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 222/437] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:36:59.031734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256b02-5fde-4bc1-94cc-e866f0beb64b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.031980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256b02-5fde-4bc1-94cc-e866f0beb64b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.054504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97744c-4ee6-4da0-9e56-35ca17c6c06f None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:59.058532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:59.128972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1256b02-5fde-4bc1-94cc-e866f0beb64b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:59.130461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1256b02-5fde-4bc1-94cc-e866f0beb64b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:59.184855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97744c-4ee6-4da0-9e56-35ca17c6c06f None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:59.224913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51968040-c62e-44e7-a4cb-efcfb75246b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:59.225732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968040-c62e-44e7-a4cb-efcfb75246b3 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.226493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968040-c62e-44e7-a4cb-efcfb75246b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.226893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968040-c62e-44e7-a4cb-efcfb75246b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.242201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51968040-c62e-44e7-a4cb-efcfb75246b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-51968040-c62e-44e7-a4cb-efcfb75246b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:59.250472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:59.251553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:59.252479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 223/438] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:36:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:36:59.253262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa864c-e28c-455a-8fd7-8c0b9e4496fc None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.253543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa864c-e28c-455a-8fd7-8c0b9e4496fc None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.253821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa864c-e28c-455a-8fd7-8c0b9e4496fc None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.255132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 224/439] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:36:59.259627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa864c-e28c-455a-8fd7-8c0b9e4496fc None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:59.265553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 216/440] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:59.267062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605ed6d-f764-4d0c-9186-8c5b14311a16 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.267494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605ed6d-f764-4d0c-9186-8c5b14311a16 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.267937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605ed6d-f764-4d0c-9186-8c5b14311a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.286094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2605ed6d-f764-4d0c-9186-8c5b14311a16 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:36:59.287922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2605ed6d-f764-4d0c-9186-8c5b14311a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:36:59.319169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:59.339653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:59.363900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 217/441] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:36:59.364743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605ed6d-f764-4d0c-9186-8c5b14311a16 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:59.383361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa864c-e28c-455a-8fd7-8c0b9e4496fc None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:59.423333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab851a3-529b-4635-9358-18ffbbe1d871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:59.423961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab851a3-529b-4635-9358-18ffbbe1d871 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.424246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab851a3-529b-4635-9358-18ffbbe1d871 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.424525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab851a3-529b-4635-9358-18ffbbe1d871 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.425286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab851a3-529b-4635-9358-18ffbbe1d871 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:59.425599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab851a3-529b-4635-9358-18ffbbe1d871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:59.429109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab851a3-529b-4635-9358-18ffbbe1d871 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:59.436625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 225/442] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:36:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:59.437593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab851a3-529b-4635-9358-18ffbbe1d871 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:59.478581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605ed6d-f764-4d0c-9186-8c5b14311a16 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:59.515974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b0838-66d2-4f06-a1f7-d6cf0107c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:59.516841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b0838-66d2-4f06-a1f7-d6cf0107c690 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.517126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b0838-66d2-4f06-a1f7-d6cf0107c690 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.517404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b0838-66d2-4f06-a1f7-d6cf0107c690 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.518647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b0838-66d2-4f06-a1f7-d6cf0107c690 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:59.520121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b0838-66d2-4f06-a1f7-d6cf0107c690 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:59.521866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 218/443] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:59 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:59.522671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b0838-66d2-4f06-a1f7-d6cf0107c690 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:59.558103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab851a3-529b-4635-9358-18ffbbe1d871 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:59.560178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:59.585654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:59.596532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce7f4-cf42-4d78-853d-c15ab187ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:59.597369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce7f4-cf42-4d78-853d-c15ab187ddbf None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.597906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce7f4-cf42-4d78-853d-c15ab187ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.597906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ce7f4-cf42-4d78-853d-c15ab187ddbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.615666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ce7f4-cf42-4d78-853d-c15ab187ddbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-d70ce7f4-cf42-4d78-853d-c15ab187ddbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:36:59.624048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:36:59.625169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 226/444] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:36:59.626018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce7f4-cf42-4d78-853d-c15ab187ddbf None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:59.637630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b0838-66d2-4f06-a1f7-d6cf0107c690 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:59.676844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772cd7c-a9fe-4419-a6d0-111433a312ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:59.677497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772cd7c-a9fe-4419-a6d0-111433a312ac None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.677778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772cd7c-a9fe-4419-a6d0-111433a312ac None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.678061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772cd7c-a9fe-4419-a6d0-111433a312ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.735120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ce7f4-cf42-4d78-853d-c15ab187ddbf None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:59.756572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772cd7c-a9fe-4419-a6d0-111433a312ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:59.758031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772cd7c-a9fe-4419-a6d0-111433a312ac None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:59.774235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464f24c-78ab-4ffc-a0ff-f4a4854dcdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:59.775320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464f24c-78ab-4ffc-a0ff-f4a4854dcdf2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.775612 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464f24c-78ab-4ffc-a0ff-f4a4854dcdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.775903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464f24c-78ab-4ffc-a0ff-f4a4854dcdf2 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.777157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464f24c-78ab-4ffc-a0ff-f4a4854dcdf2 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:59.778868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464f24c-78ab-4ffc-a0ff-f4a4854dcdf2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:59.780348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 227/445] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:36:59 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:59.781119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464f24c-78ab-4ffc-a0ff-f4a4854dcdf2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:59.795493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:59.842174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:36:59.865514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 219/446] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:36:59.866711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772cd7c-a9fe-4419-a6d0-111433a312ac None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:59.892370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464f24c-78ab-4ffc-a0ff-f4a4854dcdf2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:59.928149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792a7f3-0df1-4b0b-b2a9-ed02fb345795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:36:59.928832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a7f3-0df1-4b0b-b2a9-ed02fb345795 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:36:59.929113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a7f3-0df1-4b0b-b2a9-ed02fb345795 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:36:59.929388 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a7f3-0df1-4b0b-b2a9-ed02fb345795 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:36:59.930695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792a7f3-0df1-4b0b-b2a9-ed02fb345795 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:36:59.931005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792a7f3-0df1-4b0b-b2a9-ed02fb345795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:36:59.932376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792a7f3-0df1-4b0b-b2a9-ed02fb345795 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:36:59.940923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 228/447] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:36:59.941721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792a7f3-0df1-4b0b-b2a9-ed02fb345795 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:36:59.967573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772cd7c-a9fe-4419-a6d0-111433a312ac None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:36:59.995358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:00.001911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be798f9b-1068-415b-83c1-b876bca20b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:00.002583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be798f9b-1068-415b-83c1-b876bca20b04 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:00.002868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be798f9b-1068-415b-83c1-b876bca20b04 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:00.003150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be798f9b-1068-415b-83c1-b876bca20b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:00.003973 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be798f9b-1068-415b-83c1-b876bca20b04 None admin] RBAC: Adding query filter params (group.id=92de0b650c9a486ea54f79cae6543172, role.id=6942da52ad6b472c8c12f7e2f9e7fd9b, scope.project.id=0f85f312c90640a8a492326b31767a81) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:00.004283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be798f9b-1068-415b-83c1-b876bca20b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:00.005701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be798f9b-1068-415b-83c1-b876bca20b04 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:00.012536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 220/448] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:36:59 2022] GET /identity/v3/role_assignments?group.id=92de0b650c9a486ea54f79cae6543172&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=6942da52ad6b472c8c12f7e2f9e7fd9b => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:00.013137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be798f9b-1068-415b-83c1-b876bca20b04 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:00.055030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792a7f3-0df1-4b0b-b2a9-ed02fb345795 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:00.074105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:00.095665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971d1d-0cc9-454d-98bd-ace3612bbcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:00.096576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971d1d-0cc9-454d-98bd-ace3612bbcd2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:00.096876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971d1d-0cc9-454d-98bd-ace3612bbcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:00.097119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971d1d-0cc9-454d-98bd-ace3612bbcd2 None admin] PATH_INFO: `/v3/projects/0f85f312c90640a8a492326b31767a81` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:00.098690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971d1d-0cc9-454d-98bd-ace3612bbcd2 None admin] RBAC: Authorizing `identity:get_project(project_id=0f85f312c90640a8a492326b31767a81)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:00.100023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971d1d-0cc9-454d-98bd-ace3612bbcd2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:00.106773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 229/449] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:36:59 2022] GET /identity/v3/projects/0f85f312c90640a8a492326b31767a81 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:00.108041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971d1d-0cc9-454d-98bd-ace3612bbcd2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:00.156363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be798f9b-1068-415b-83c1-b876bca20b04 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:00.200987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052065e0-ddee-4007-a195-6befcaee91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:00.201802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052065e0-ddee-4007-a195-6befcaee91b3 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:00.202092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052065e0-ddee-4007-a195-6befcaee91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:00.202857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052065e0-ddee-4007-a195-6befcaee91b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:00.229925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971d1d-0cc9-454d-98bd-ace3612bbcd2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:00.267069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d56b91-81bf-4830-8d32-9176df884ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:00.267925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d56b91-81bf-4830-8d32-9176df884ef2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:00.268205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d56b91-81bf-4830-8d32-9176df884ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:00.268481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d56b91-81bf-4830-8d32-9176df884ef2 None admin] PATH_INFO: `/v3/groups/92de0b650c9a486ea54f79cae6543172` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:00.269695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d56b91-81bf-4830-8d32-9176df884ef2 None admin] RBAC: Authorizing `identity:get_group(group_id=92de0b650c9a486ea54f79cae6543172)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:00.271296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d56b91-81bf-4830-8d32-9176df884ef2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:00.272826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 230/450] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:37:00 2022] GET /identity/v3/groups/92de0b650c9a486ea54f79cae6543172 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:00.279262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d56b91-81bf-4830-8d32-9176df884ef2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:00.282364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:00.292244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052065e0-ddee-4007-a195-6befcaee91b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:00.294083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052065e0-ddee-4007-a195-6befcaee91b3 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:00.345191 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:00.410856 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d56b91-81bf-4830-8d32-9176df884ef2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:00.414849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 221/451] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:37:00.420377 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052065e0-ddee-4007-a195-6befcaee91b3 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:00.444567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d32c4c-8714-4d21-b358-b9bb188f722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:00.445218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d32c4c-8714-4d21-b358-b9bb188f722a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:00.445507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d32c4c-8714-4d21-b358-b9bb188f722a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:00.446422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d32c4c-8714-4d21-b358-b9bb188f722a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:00.447407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d32c4c-8714-4d21-b358-b9bb188f722a None admin] RBAC: Adding query filter params (group.id=92de0b650c9a486ea54f79cae6543172, role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=0f85f312c90640a8a492326b31767a81) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:00.447726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d32c4c-8714-4d21-b358-b9bb188f722a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:00.449173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d32c4c-8714-4d21-b358-b9bb188f722a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:00.455158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 231/452] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:37:00 2022] GET /identity/v3/role_assignments?group.id=92de0b650c9a486ea54f79cae6543172&scope.project.id=0f85f312c90640a8a492326b31767a81&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:00.519516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:00.530423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052065e0-ddee-4007-a195-6befcaee91b3 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:00.569647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23338e1-e8b3-486e-a638-da8bd83cde45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:00.570601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23338e1-e8b3-486e-a638-da8bd83cde45 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:00.570916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23338e1-e8b3-486e-a638-da8bd83cde45 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:00.571499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23338e1-e8b3-486e-a638-da8bd83cde45 None admin] PATH_INFO: `/v3/projects/90bfbe3ca19640a8a67be01b638e500f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:00.572494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23338e1-e8b3-486e-a638-da8bd83cde45 None admin] RBAC: Authorizing `identity:get_project(project_id=90bfbe3ca19640a8a67be01b638e500f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:00.573990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23338e1-e8b3-486e-a638-da8bd83cde45 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:00.575809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 222/453] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:37:00 2022] GET /identity/v3/projects/90bfbe3ca19640a8a67be01b638e500f => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:00.581559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d32c4c-8714-4d21-b358-b9bb188f722a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:00.686748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d32c4c-8714-4d21-b358-b9bb188f722a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:00.703336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:00.722697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6af62-8004-4a43-a71c-262ad2ca674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:00.723550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6af62-8004-4a43-a71c-262ad2ca674e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:00.723840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6af62-8004-4a43-a71c-262ad2ca674e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:00.724126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6af62-8004-4a43-a71c-262ad2ca674e None admin] PATH_INFO: `/v3/groups/af4457947c1d4ed6a9af81a670f7c3ec` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:00.725304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6af62-8004-4a43-a71c-262ad2ca674e None admin] RBAC: Authorizing `identity:get_group(group_id=af4457947c1d4ed6a9af81a670f7c3ec)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:00.726797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6af62-8004-4a43-a71c-262ad2ca674e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:00.728573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 232/454] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jun 23 10:37:00 2022] GET /identity/v3/groups/af4457947c1d4ed6a9af81a670f7c3ec => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:00.734560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23338e1-e8b3-486e-a638-da8bd83cde45 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:00.837526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23338e1-e8b3-486e-a638-da8bd83cde45 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:00.869899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6536043-98e0-4e0b-ac5a-b91d10259c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:00.870571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536043-98e0-4e0b-ac5a-b91d10259c6b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:00.870853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536043-98e0-4e0b-ac5a-b91d10259c6b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:00.871125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6536043-98e0-4e0b-ac5a-b91d10259c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:00.871949 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6536043-98e0-4e0b-ac5a-b91d10259c6b None admin] RBAC: Adding query filter params (group.id=af4457947c1d4ed6a9af81a670f7c3ec, role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=90bfbe3ca19640a8a67be01b638e500f) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:00.872259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6536043-98e0-4e0b-ac5a-b91d10259c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:00.873683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6536043-98e0-4e0b-ac5a-b91d10259c6b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:00.879293 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 223/455] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jun 23 10:37:00 2022] GET /identity/v3/role_assignments?group.id=af4457947c1d4ed6a9af81a670f7c3ec&scope.project.id=90bfbe3ca19640a8a67be01b638e500f&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:03.539073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864e61b-32a3-4960-b2e8-bb7242d3c504 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:03.540135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864e61b-32a3-4960-b2e8-bb7242d3c504 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:03.540418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864e61b-32a3-4960-b2e8-bb7242d3c504 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:03.541931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 233/456] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:03.547696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d08be6-d45e-47cc-9ea3-eae472f93d0f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:03.548146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d08be6-d45e-47cc-9ea3-eae472f93d0f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:03.548238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d08be6-d45e-47cc-9ea3-eae472f93d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:03.579432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-f4d08be6-d45e-47cc-9ea3-eae472f93d0f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:03.580639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f4d08be6-d45e-47cc-9ea3-eae472f93d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:03.608983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:03.684572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 224/457] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:03.725312 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326197b-5f8e-44a0-8c0a-e4901fd4bdaa None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:03.725619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326197b-5f8e-44a0-8c0a-e4901fd4bdaa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:03.725947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326197b-5f8e-44a0-8c0a-e4901fd4bdaa None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:03.728219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 234/458] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:03.729353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d08be6-d45e-47cc-9ea3-eae472f93d0f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:03.733692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c253e-b315-465b-9fea-1c4081e20147 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:03.734284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c253e-b315-465b-9fea-1c4081e20147 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:03.734671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c253e-b315-465b-9fea-1c4081e20147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:03.756802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-cb7c253e-b315-465b-9fea-1c4081e20147 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:03.758536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-cb7c253e-b315-465b-9fea-1c4081e20147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:03.846968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 235/459] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:37:03.847540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d08be6-d45e-47cc-9ea3-eae472f93d0f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:03.848731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44965188-e1d2-4a49-b882-36ebf35c10e5 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:03.849351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44965188-e1d2-4a49-b882-36ebf35c10e5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:03.849807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44965188-e1d2-4a49-b882-36ebf35c10e5 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:03.853318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 236/460] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:03.859811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299d81b-62bb-4459-b3a9-ee043acbb9c2 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:03.862673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299d81b-62bb-4459-b3a9-ee043acbb9c2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:03.863113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299d81b-62bb-4459-b3a9-ee043acbb9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:03.888389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-4299d81b-62bb-4459-b3a9-ee043acbb9c2 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:03.890501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4299d81b-62bb-4459-b3a9-ee043acbb9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:03.900670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8fd65-ebdd-4a46-8f00-75ba31fa604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:03.902262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8fd65-ebdd-4a46-8f00-75ba31fa604a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:03.902815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8fd65-ebdd-4a46-8f00-75ba31fa604a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:03.903232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8fd65-ebdd-4a46-8f00-75ba31fa604a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:03.916333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8fd65-ebdd-4a46-8f00-75ba31fa604a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:03.918766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8fd65-ebdd-4a46-8f00-75ba31fa604a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-fed8fd65-ebdd-4a46-8f00-75ba31fa604a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:03.942297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:03.943464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:03.944510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:03.944510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:03.944510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:03.944510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:03.947290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 225/461] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:03.948855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8fd65-ebdd-4a46-8f00-75ba31fa604a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:03.967846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:03.981635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 237/462] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:03.982661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299d81b-62bb-4459-b3a9-ee043acbb9c2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:04.045454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:04.109305 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8fd65-ebdd-4a46-8f00-75ba31fa604a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:04.118101 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299d81b-62bb-4459-b3a9-ee043acbb9c2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:04.162750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a53b9-533a-435c-b481-180637dc002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:04.163555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a53b9-533a-435c-b481-180637dc002d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:04.163840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a53b9-533a-435c-b481-180637dc002d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:04.164133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a53b9-533a-435c-b481-180637dc002d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:04.166649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79d54-675b-4bb7-916e-6f3206a63fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:04.167507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79d54-675b-4bb7-916e-6f3206a63fab None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:04.167961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79d54-675b-4bb7-916e-6f3206a63fab None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:04.168394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79d54-675b-4bb7-916e-6f3206a63fab None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:04.169262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79d54-675b-4bb7-916e-6f3206a63fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:04.169752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79d54-675b-4bb7-916e-6f3206a63fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:04.171306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79d54-675b-4bb7-916e-6f3206a63fab None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:04.176034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a53b9-533a-435c-b481-180637dc002d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:04.177505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a53b9-533a-435c-b481-180637dc002d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:04.184824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 238/463] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:04.185851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79d54-675b-4bb7-916e-6f3206a63fab None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-ad8a53b9-533a-435c-b481-180637dc002d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:04.202607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:04.203555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:04.205838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:04.205838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:04.205838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:04.205838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:04.205838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 226/464] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:04.205838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a05f73-e2e1-43b0-83c3-e01033523b4e None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:04.205838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a05f73-e2e1-43b0-83c3-e01033523b4e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:04.206232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a05f73-e2e1-43b0-83c3-e01033523b4e None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:04.207563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 227/465] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:04.210401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a05f73-e2e1-43b0-83c3-e01033523b4e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:04.280857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:04.296576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79d54-675b-4bb7-916e-6f3206a63fab None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:04.300267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:04.334680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a05f73-e2e1-43b0-83c3-e01033523b4e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:04.348138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9ab9d-5f9d-4883-a74a-ea790165ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:04.348807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9ab9d-5f9d-4883-a74a-ea790165ce47 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:04.349094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9ab9d-5f9d-4883-a74a-ea790165ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:04.349416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9ab9d-5f9d-4883-a74a-ea790165ce47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:04.362457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9ab9d-5f9d-4883-a74a-ea790165ce47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:04.363916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9ab9d-5f9d-4883-a74a-ea790165ce47 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-8ba9ab9d-5f9d-4883-a74a-ea790165ce47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:04.383022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:04.383975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:04.384826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:04.384826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:04.384826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:04.384826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:04.384826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 239/466] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:04.385108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9ab9d-5f9d-4883-a74a-ea790165ce47 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:04.397059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea7cca-01ed-4e68-8886-f80a96dda75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:04.397827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea7cca-01ed-4e68-8886-f80a96dda75b None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:04.398109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea7cca-01ed-4e68-8886-f80a96dda75b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:04.398421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea7cca-01ed-4e68-8886-f80a96dda75b None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:04.399254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea7cca-01ed-4e68-8886-f80a96dda75b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:04.401032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea7cca-01ed-4e68-8886-f80a96dda75b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:04.426810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 228/467] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:37:04 2022] POST /identity/v3/users => generated 246 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:04.428720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908c2b7-6773-4102-9f50-3ecb093f2265 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:04.429147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908c2b7-6773-4102-9f50-3ecb093f2265 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:04.429521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908c2b7-6773-4102-9f50-3ecb093f2265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:04.466356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a908c2b7-6773-4102-9f50-3ecb093f2265 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:04.469156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a908c2b7-6773-4102-9f50-3ecb093f2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:04.584436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9ab9d-5f9d-4883-a74a-ea790165ce47 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:04.615113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 229/468] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:04.616217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908c2b7-6773-4102-9f50-3ecb093f2265 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:04.661659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb27e9b-de61-4ff0-b628-2aa7705937d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:04.662958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb27e9b-de61-4ff0-b628-2aa7705937d9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:04.663473 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb27e9b-de61-4ff0-b628-2aa7705937d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:04.663927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb27e9b-de61-4ff0-b628-2aa7705937d9 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:04.666365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb27e9b-de61-4ff0-b628-2aa7705937d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:04.667049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb27e9b-de61-4ff0-b628-2aa7705937d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:04.669687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb27e9b-de61-4ff0-b628-2aa7705937d9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:04.681230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:04.690307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 240/469] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:04.691114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb27e9b-de61-4ff0-b628-2aa7705937d9 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:04.716409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:04.763143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908c2b7-6773-4102-9f50-3ecb093f2265 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:04.813803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853cb2-d223-4a06-8c57-aa966f6f42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:04.814505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853cb2-d223-4a06-8c57-aa966f6f42dc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:04.815184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853cb2-d223-4a06-8c57-aa966f6f42dc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:04.815602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3853cb2-d223-4a06-8c57-aa966f6f42dc None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:04.816336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853cb2-d223-4a06-8c57-aa966f6f42dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:04.816644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853cb2-d223-4a06-8c57-aa966f6f42dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:04.819033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3853cb2-d223-4a06-8c57-aa966f6f42dc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:04.821671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb27e9b-de61-4ff0-b628-2aa7705937d9 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:04.848545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 230/470] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:04.848545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853cb2-d223-4a06-8c57-aa966f6f42dc None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:04.872818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0f2b8-f1e8-45c7-b12d-440bfe6e3f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:04.874010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f2b8-f1e8-45c7-b12d-440bfe6e3f1e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:04.874534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f2b8-f1e8-45c7-b12d-440bfe6e3f1e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:04.875033 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0f2b8-f1e8-45c7-b12d-440bfe6e3f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:04.886570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0f2b8-f1e8-45c7-b12d-440bfe6e3f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:04.888395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0f2b8-f1e8-45c7-b12d-440bfe6e3f1e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-32a0f2b8-f1e8-45c7-b12d-440bfe6e3f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:04.908262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:04.909174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:04.910149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:04.910149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:04.910149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:04.910149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:04.912505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 241/471] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:04.913636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0f2b8-f1e8-45c7-b12d-440bfe6e3f1e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:04.973663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3853cb2-d223-4a06-8c57-aa966f6f42dc None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:04.986493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:05.013905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:05.031604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375e57c-45b4-4dae-ab5e-9a023d292c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:05.032907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375e57c-45b4-4dae-ab5e-9a023d292c8a None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:05.033924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375e57c-45b4-4dae-ab5e-9a023d292c8a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:05.034700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375e57c-45b4-4dae-ab5e-9a023d292c8a None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:05.035667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375e57c-45b4-4dae-ab5e-9a023d292c8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:05.037996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375e57c-45b4-4dae-ab5e-9a023d292c8a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:05.053916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0f2b8-f1e8-45c7-b12d-440bfe6e3f1e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:05.067709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 231/472] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:37:04 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:05.068376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375e57c-45b4-4dae-ab5e-9a023d292c8a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:05.107615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdbb13-d067-47b3-aeca-7a13a853c9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:05.108971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdbb13-d067-47b3-aeca-7a13a853c9c0 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:05.110048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdbb13-d067-47b3-aeca-7a13a853c9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:05.110909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdbb13-d067-47b3-aeca-7a13a853c9c0 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:05.111966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdbb13-d067-47b3-aeca-7a13a853c9c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:05.114770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdbb13-d067-47b3-aeca-7a13a853c9c0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:05.157354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 242/473] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:37:04 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:05.158735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1e1ab-0df8-4524-a853-7d7fa61730b6 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:05.159141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1e1ab-0df8-4524-a853-7d7fa61730b6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:05.159477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1e1ab-0df8-4524-a853-7d7fa61730b6 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:05.160865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 243/474] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:05.167622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbbb7a-3a9e-4527-9a62-97a41603ea79 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:05.167992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbbb7a-3a9e-4527-9a62-97a41603ea79 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:05.168279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbbb7a-3a9e-4527-9a62-97a41603ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:05.187786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-79dbbb7a-3a9e-4527-9a62-97a41603ea79 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:05.189055 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-79dbbb7a-3a9e-4527-9a62-97a41603ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:05.219457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375e57c-45b4-4dae-ab5e-9a023d292c8a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:05.265088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c462a-cbb3-46a4-87f8-d67e353892f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:05.266455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c462a-cbb3-46a4-87f8-d67e353892f6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:05.266764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c462a-cbb3-46a4-87f8-d67e353892f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:05.267056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c462a-cbb3-46a4-87f8-d67e353892f6 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:05.267861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c462a-cbb3-46a4-87f8-d67e353892f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:05.268182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c462a-cbb3-46a4-87f8-d67e353892f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:05.269674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c462a-cbb3-46a4-87f8-d67e353892f6 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:05.286117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 232/475] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:05.294693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c462a-cbb3-46a4-87f8-d67e353892f6 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:05.343002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 244/476] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:37:05.344668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:05.382822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbbb7a-3a9e-4527-9a62-97a41603ea79 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:05.468190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:05.481933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c462a-cbb3-46a4-87f8-d67e353892f6 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:05.543976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23900d1c-a970-4226-9a37-68029c14743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:05.545370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23900d1c-a970-4226-9a37-68029c14743d None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:05.545665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23900d1c-a970-4226-9a37-68029c14743d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:05.545990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23900d1c-a970-4226-9a37-68029c14743d None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:05.546769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23900d1c-a970-4226-9a37-68029c14743d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:05.546948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbbb7a-3a9e-4527-9a62-97a41603ea79 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:05.548288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23900d1c-a970-4226-9a37-68029c14743d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:05.576139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 233/477] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:37:05 2022] POST /identity/v3/users => generated 249 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:37:05.610229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:05.610955 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:05.611230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:05.611512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:05.612350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:05.613797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:05.630455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.sql.core [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 10:37:05.630455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 10:37:05.630455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [parameters: {'id': 'ea003667190842fc92b92b5733502d1d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 10:37:05.630455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91931) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result.read() Jun 23 10:37:05.648390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:37:05.649380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application yield resource Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise self.value Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application session.commit() Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 10:37:05.650383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.session.flush() Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application compat.raise_( Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 10:37:05.651339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:37:05.652233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result.read() Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:37:05.653157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [parameters: {'id': 'ea003667190842fc92b92b5733502d1d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:05.653963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 10:37:05.658469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:05.660481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 245/478] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 23 10:37:05 2022] POST /identity/v3/roles => generated 144 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:05.660619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23900d1c-a970-4226-9a37-68029c14743d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:05.786901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:05.818589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23900d1c-a970-4226-9a37-68029c14743d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:05.869691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8499ec3-dedb-4ff0-a35d-00b11e3140f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:05.870562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8499ec3-dedb-4ff0-a35d-00b11e3140f4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:05.870851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8499ec3-dedb-4ff0-a35d-00b11e3140f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:05.871135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8499ec3-dedb-4ff0-a35d-00b11e3140f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:05.890856 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8499ec3-dedb-4ff0-a35d-00b11e3140f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-b8499ec3-dedb-4ff0-a35d-00b11e3140f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:05.899078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:05.900137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:05.900993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 234/479] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:05.905968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:06.027126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1557-5aa9-4f3e-94af-9baf7682f4d5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:06.046914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:06.065405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b574c-371a-4ecd-8618-0778f6f9051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:06.066087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b574c-371a-4ecd-8618-0778f6f9051d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:06.066414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b574c-371a-4ecd-8618-0778f6f9051d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:06.067134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b574c-371a-4ecd-8618-0778f6f9051d None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:06.067988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b574c-371a-4ecd-8618-0778f6f9051d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:06.068315 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b574c-371a-4ecd-8618-0778f6f9051d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:06.069971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b574c-371a-4ecd-8618-0778f6f9051d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:06.080226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 246/480] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:07.177277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98feae85-3647-48bf-8272-df9bba55c4b5 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:07.177826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98feae85-3647-48bf-8272-df9bba55c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:07.177826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98feae85-3647-48bf-8272-df9bba55c4b5 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:07.179488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 235/481] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:07.184961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29c3b0-d619-42b0-ac7e-efda08f62466 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:07.185849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29c3b0-d619-42b0-ac7e-efda08f62466 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:07.186347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29c3b0-d619-42b0-ac7e-efda08f62466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:07.207411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-6c29c3b0-d619-42b0-ac7e-efda08f62466 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:07.208946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6c29c3b0-d619-42b0-ac7e-efda08f62466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:07.307767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 247/482] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:07.348083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98feae85-3647-48bf-8272-df9bba55c4b5 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:07.478851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98feae85-3647-48bf-8272-df9bba55c4b5 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:07.523298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b119776-3497-4984-99be-14df3346f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:07.524998 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119776-3497-4984-99be-14df3346f280 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:07.525511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119776-3497-4984-99be-14df3346f280 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:07.525984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b119776-3497-4984-99be-14df3346f280 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:07.542298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b119776-3497-4984-99be-14df3346f280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-5b119776-3497-4984-99be-14df3346f280 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:07.550189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:07.551192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:07.552450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 236/483] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:07.554716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:07.558113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29c3b0-d619-42b0-ac7e-efda08f62466 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:07.683977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78230e4f-6a63-4999-bdde-9f2809aab941 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:07.684451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78230e4f-6a63-4999-bdde-9f2809aab941 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:07.684915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78230e4f-6a63-4999-bdde-9f2809aab941 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:07.687175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 237/484] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:07.692401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f0fb-d96e-40f9-aa94-8b371ab01fd0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:07.692696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f0fb-d96e-40f9-aa94-8b371ab01fd0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:07.692981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f0fb-d96e-40f9-aa94-8b371ab01fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:07.696813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29c3b0-d619-42b0-ac7e-efda08f62466 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:07.710627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:07.735659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-da92f0fb-d96e-40f9-aa94-8b371ab01fd0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:07.736802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-da92f0fb-d96e-40f9-aa94-8b371ab01fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:07.740416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eeb3b-743b-4489-bbc9-09a0e7f09cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:07.741089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eeb3b-743b-4489-bbc9-09a0e7f09cc8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:07.741377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eeb3b-743b-4489-bbc9-09a0e7f09cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:07.741661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047eeb3b-743b-4489-bbc9-09a0e7f09cc8 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:07.742501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eeb3b-743b-4489-bbc9-09a0e7f09cc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:07.742822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eeb3b-743b-4489-bbc9-09a0e7f09cc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:07.744288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047eeb3b-743b-4489-bbc9-09a0e7f09cc8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:07.757361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 248/485] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:07.762677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eeb3b-743b-4489-bbc9-09a0e7f09cc8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:07.821058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 238/486] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:07.822976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda9f4-62c0-47ff-95b9-e5c8983c874f None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:07.823271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda9f4-62c0-47ff-95b9-e5c8983c874f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:07.823555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeda9f4-62c0-47ff-95b9-e5c8983c874f None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:07.824885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 239/487] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:07.831750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54063b-5d99-46c1-871a-574fa5aa470c None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:07.832316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54063b-5d99-46c1-871a-574fa5aa470c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:07.832819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54063b-5d99-46c1-871a-574fa5aa470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:07.849891 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-bb54063b-5d99-46c1-871a-574fa5aa470c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:07.851523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-bb54063b-5d99-46c1-871a-574fa5aa470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:07.904635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047eeb3b-743b-4489-bbc9-09a0e7f09cc8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:07.929428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 240/488] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:37:07.929428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54063b-5d99-46c1-871a-574fa5aa470c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:07.947505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64011-8c3e-44cf-834d-41f49f31cbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:07.948292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64011-8c3e-44cf-834d-41f49f31cbef None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:07.954388 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64011-8c3e-44cf-834d-41f49f31cbef None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:07.954388 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64011-8c3e-44cf-834d-41f49f31cbef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:07.959757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64011-8c3e-44cf-834d-41f49f31cbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:07.961377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce64011-8c3e-44cf-834d-41f49f31cbef None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-7ce64011-8c3e-44cf-834d-41f49f31cbef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:07.983133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:07.984079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:07.984960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:07.984960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:07.984960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:07.984960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:07.984960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 249/489] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:07.985762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64011-8c3e-44cf-834d-41f49f31cbef None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:08.015814 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:08.016408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:08.063802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54063b-5d99-46c1-871a-574fa5aa470c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:08.100193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce64011-8c3e-44cf-834d-41f49f31cbef None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:08.102160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122a3b1-d79e-4760-9e6e-0e691ab5a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:08.104168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122a3b1-d79e-4760-9e6e-0e691ab5a67c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.104796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122a3b1-d79e-4760-9e6e-0e691ab5a67c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.105578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122a3b1-d79e-4760-9e6e-0e691ab5a67c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.123218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122a3b1-d79e-4760-9e6e-0e691ab5a67c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-d122a3b1-d79e-4760-9e6e-0e691ab5a67c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:08.132334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:08.133822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:08.134711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:08.137424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 241/490] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:08.138553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122a3b1-d79e-4760-9e6e-0e691ab5a67c None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:08.141586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88537375-5498-4798-a233-d243a0dbf334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:08.143487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88537375-5498-4798-a233-d243a0dbf334 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.143487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88537375-5498-4798-a233-d243a0dbf334 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.143487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88537375-5498-4798-a233-d243a0dbf334 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.155218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88537375-5498-4798-a233-d243a0dbf334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-88537375-5498-4798-a233-d243a0dbf334 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:08.163727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:08.165000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 250/491] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:08.165818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88537375-5498-4798-a233-d243a0dbf334 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:08.254012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122a3b1-d79e-4760-9e6e-0e691ab5a67c None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:08.272570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:08.276236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88537375-5498-4798-a233-d243a0dbf334 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:08.290788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:08.295467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901950dc-7d69-4870-b3cb-6d0166206c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:08.296805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901950dc-7d69-4870-b3cb-6d0166206c71 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.297618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901950dc-7d69-4870-b3cb-6d0166206c71 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.298457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901950dc-7d69-4870-b3cb-6d0166206c71 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.301149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901950dc-7d69-4870-b3cb-6d0166206c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:08.301936 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901950dc-7d69-4870-b3cb-6d0166206c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:08.303721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901950dc-7d69-4870-b3cb-6d0166206c71 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:08.316969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a1bc-1c32-480d-ab7c-bf858501e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:08.317636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a1bc-1c32-480d-ab7c-bf858501e58d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.317919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a1bc-1c32-480d-ab7c-bf858501e58d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.318204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69a1bc-1c32-480d-ab7c-bf858501e58d None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.319048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a1bc-1c32-480d-ab7c-bf858501e58d None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:08.319360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a1bc-1c32-480d-ab7c-bf858501e58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:08.324669 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69a1bc-1c32-480d-ab7c-bf858501e58d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:08.324988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 242/492] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:08.326148 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901950dc-7d69-4870-b3cb-6d0166206c71 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:08.331307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 251/493] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:08.331868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a1bc-1c32-480d-ab7c-bf858501e58d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:08.446429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69a1bc-1c32-480d-ab7c-bf858501e58d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:08.453801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901950dc-7d69-4870-b3cb-6d0166206c71 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:08.483395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b377ec-98b6-47c5-9c04-be3927aea59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:08.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b377ec-98b6-47c5-9c04-be3927aea59c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.484473 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b377ec-98b6-47c5-9c04-be3927aea59c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.484751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b377ec-98b6-47c5-9c04-be3927aea59c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.494269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b377ec-98b6-47c5-9c04-be3927aea59c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:08.495764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b377ec-98b6-47c5-9c04-be3927aea59c None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:08.513069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ebebf-ab0c-40cc-af2f-da492d1f5691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:08.513750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ebebf-ab0c-40cc-af2f-da492d1f5691 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.514046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ebebf-ab0c-40cc-af2f-da492d1f5691 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-36b377ec-98b6-47c5-9c04-be3927aea59c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:08.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:08.515280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:08.516562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:08.517276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ebebf-ab0c-40cc-af2f-da492d1f5691 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.517353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 252/494] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 23 10:37:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:08.517353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b377ec-98b6-47c5-9c04-be3927aea59c None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:08.519666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ebebf-ab0c-40cc-af2f-da492d1f5691 None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:08.521669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ebebf-ab0c-40cc-af2f-da492d1f5691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:08.527678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:08.528025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ebebf-ab0c-40cc-af2f-da492d1f5691 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:08.545604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 243/495] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:08.548398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a09b8-8be3-4290-975c-61726b2dfb3b None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.548982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a09b8-8be3-4290-975c-61726b2dfb3b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.549579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a09b8-8be3-4290-975c-61726b2dfb3b None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.552653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 244/496] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:08.555953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a09b8-8be3-4290-975c-61726b2dfb3b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:08.619179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:08.692929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b377ec-98b6-47c5-9c04-be3927aea59c None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:08.693162 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a09b8-8be3-4290-975c-61726b2dfb3b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:08.734829 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b201e9-152b-4700-be0d-d4150b0ad61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:08.736073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b201e9-152b-4700-be0d-d4150b0ad61e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.736540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b201e9-152b-4700-be0d-d4150b0ad61e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.736998 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b201e9-152b-4700-be0d-d4150b0ad61e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.756037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b201e9-152b-4700-be0d-d4150b0ad61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:08.756227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bd5b7-bec8-4a18-aa38-bd49b003b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:08.757157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bd5b7-bec8-4a18-aa38-bd49b003b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.757595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bd5b7-bec8-4a18-aa38-bd49b003b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.758654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bd5b7-bec8-4a18-aa38-bd49b003b2d8 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.759176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b201e9-152b-4700-be0d-d4150b0ad61e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:08.761839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bd5b7-bec8-4a18-aa38-bd49b003b2d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:08.762222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bd5b7-bec8-4a18-aa38-bd49b003b2d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:08.765109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bd5b7-bec8-4a18-aa38-bd49b003b2d8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-b2b201e9-152b-4700-be0d-d4150b0ad61e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:08.789152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:08.790092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:08.791074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:08.791074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:08.791074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:08.791074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:08.794897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 253/497] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:08.796163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b201e9-152b-4700-be0d-d4150b0ad61e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:08.829336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 245/498] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 23 10:37:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:08.832550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc5f10-795d-497a-82e5-907cff51e62b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:08.832847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc5f10-795d-497a-82e5-907cff51e62b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:08.833133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc5f10-795d-497a-82e5-907cff51e62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:08.853896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-04fc5f10-795d-497a-82e5-907cff51e62b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:08.855123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-04fc5f10-795d-497a-82e5-907cff51e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:08.885046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:08.948453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b201e9-152b-4700-be0d-d4150b0ad61e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:08.958677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 246/499] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:08.959543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc5f10-795d-497a-82e5-907cff51e62b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.000183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:09.007390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bc0f4-ee2e-49d5-a5a6-e0651317aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.008855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bc0f4-ee2e-49d5-a5a6-e0651317aa37 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.009142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bc0f4-ee2e-49d5-a5a6-e0651317aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.009417 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bc0f4-ee2e-49d5-a5a6-e0651317aa37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.020987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bc0f4-ee2e-49d5-a5a6-e0651317aa37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:09.022404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bc0f4-ee2e-49d5-a5a6-e0651317aa37 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-663bc0f4-ee2e-49d5-a5a6-e0651317aa37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:09.041067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:09.041995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:09.043233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:09.043233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:09.043233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:09.043233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:09.043233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 254/500] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:09.043233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bc0f4-ee2e-49d5-a5a6-e0651317aa37 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.115376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc5f10-795d-497a-82e5-907cff51e62b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:09.166184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31b89e-1223-4398-8ed0-f71b93c88200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.167310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31b89e-1223-4398-8ed0-f71b93c88200 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.167795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31b89e-1223-4398-8ed0-f71b93c88200 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.168196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31b89e-1223-4398-8ed0-f71b93c88200 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.168968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31b89e-1223-4398-8ed0-f71b93c88200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:09.169280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31b89e-1223-4398-8ed0-f71b93c88200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:09.171520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31b89e-1223-4398-8ed0-f71b93c88200 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:09.191707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 247/501] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:09.191707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31b89e-1223-4398-8ed0-f71b93c88200 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.194962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bc0f4-ee2e-49d5-a5a6-e0651317aa37 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:09.209357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:09.237654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9931-5233-45a5-952c-accacadcf953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.238356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9931-5233-45a5-952c-accacadcf953 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.238650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9931-5233-45a5-952c-accacadcf953 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.238931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9931-5233-45a5-952c-accacadcf953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.293331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:09.307313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31b89e-1223-4398-8ed0-f71b93c88200 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:09.323944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c9931-5233-45a5-952c-accacadcf953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:09.325445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c9931-5233-45a5-952c-accacadcf953 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:09.345681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34236d70-b7ee-46ad-85c3-e4860d226cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.346510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34236d70-b7ee-46ad-85c3-e4860d226cdd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.346941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34236d70-b7ee-46ad-85c3-e4860d226cdd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.347221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34236d70-b7ee-46ad-85c3-e4860d226cdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.360374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34236d70-b7ee-46ad-85c3-e4860d226cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-34236d70-b7ee-46ad-85c3-e4860d226cdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:09.369081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:09.370275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:09.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 248/502] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:09.371837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34236d70-b7ee-46ad-85c3-e4860d226cdd None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.443011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 255/503] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:37:09.444654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4457553-3b39-4296-975e-b7958c70e972 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.445128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4457553-3b39-4296-975e-b7958c70e972 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.445704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4457553-3b39-4296-975e-b7958c70e972 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.447203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 256/504] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:09.451273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4457553-3b39-4296-975e-b7958c70e972 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.463677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:09.489719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34236d70-b7ee-46ad-85c3-e4860d226cdd None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:09.524591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51cebf-9e15-4106-97fd-57e56dd9eb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.525242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51cebf-9e15-4106-97fd-57e56dd9eb02 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.525524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51cebf-9e15-4106-97fd-57e56dd9eb02 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.525802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51cebf-9e15-4106-97fd-57e56dd9eb02 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.526564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51cebf-9e15-4106-97fd-57e56dd9eb02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:09.526877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51cebf-9e15-4106-97fd-57e56dd9eb02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:09.528251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51cebf-9e15-4106-97fd-57e56dd9eb02 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:09.543697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 249/505] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:09.544502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51cebf-9e15-4106-97fd-57e56dd9eb02 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.556657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:09.564024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4457553-3b39-4296-975e-b7958c70e972 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:09.610898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd3407-13ee-4ded-b771-b0d814c798ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.611803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd3407-13ee-4ded-b771-b0d814c798ab None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.612127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd3407-13ee-4ded-b771-b0d814c798ab None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.612491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd3407-13ee-4ded-b771-b0d814c798ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.622276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd3407-13ee-4ded-b771-b0d814c798ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:09.623783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd3407-13ee-4ded-b771-b0d814c798ab None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-c4cd3407-13ee-4ded-b771-b0d814c798ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:09.638734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:09.639840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:37:09.640742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:09.644687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 257/506] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:09.645516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd3407-13ee-4ded-b771-b0d814c798ab None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.650735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51cebf-9e15-4106-97fd-57e56dd9eb02 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:09.688274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15997b69-7b4b-4333-8877-a2109c6aa4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.689326 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997b69-7b4b-4333-8877-a2109c6aa4eb None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.690044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997b69-7b4b-4333-8877-a2109c6aa4eb None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.690541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997b69-7b4b-4333-8877-a2109c6aa4eb None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.691802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15997b69-7b4b-4333-8877-a2109c6aa4eb None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:09.692290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15997b69-7b4b-4333-8877-a2109c6aa4eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:09.694735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15997b69-7b4b-4333-8877-a2109c6aa4eb None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:09.703917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 250/507] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:09.705268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e104c-0c42-4e15-ba4c-5bf9a4fee917 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.705564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e104c-0c42-4e15-ba4c-5bf9a4fee917 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.705847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e104c-0c42-4e15-ba4c-5bf9a4fee917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.723254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d74e104c-0c42-4e15-ba4c-5bf9a4fee917 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:09.724477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d74e104c-0c42-4e15-ba4c-5bf9a4fee917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:09.725960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:09.758456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd3407-13ee-4ded-b771-b0d814c798ab None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:09.788525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:09.794143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 251/508] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:09.794439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226f919-c7b4-4d07-97f2-19d72c145735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.794823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e104c-0c42-4e15-ba4c-5bf9a4fee917 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.795244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226f919-c7b4-4d07-97f2-19d72c145735 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.795519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226f919-c7b4-4d07-97f2-19d72c145735 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.795800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226f919-c7b4-4d07-97f2-19d72c145735 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.808336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226f919-c7b4-4d07-97f2-19d72c145735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:09.810501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226f919-c7b4-4d07-97f2-19d72c145735 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-f226f919-c7b4-4d07-97f2-19d72c145735 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:09.831463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:09.832445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:09.833306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:09.833306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:09.833306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:09.833306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:09.833306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 258/509] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:09.833579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226f919-c7b4-4d07-97f2-19d72c145735 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.903481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e104c-0c42-4e15-ba4c-5bf9a4fee917 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:09.938059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226f919-c7b4-4d07-97f2-19d72c145735 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:09.938679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43173524-6d25-4e42-ba6c-c58568d09521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.939547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173524-6d25-4e42-ba6c-c58568d09521 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.940101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173524-6d25-4e42-ba6c-c58568d09521 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.940366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173524-6d25-4e42-ba6c-c58568d09521 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.948320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43173524-6d25-4e42-ba6c-c58568d09521 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:09.951329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43173524-6d25-4e42-ba6c-c58568d09521 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:09.964497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-43173524-6d25-4e42-ba6c-c58568d09521 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:09.969706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:09.970741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 252/510] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:09.971920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43173524-6d25-4e42-ba6c-c58568d09521 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:09.982810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8133-e5aa-43e3-8188-9dbddc4896c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:09.983491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8133-e5aa-43e3-8188-9dbddc4896c6 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:09.983767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8133-e5aa-43e3-8188-9dbddc4896c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:09.984051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c8133-e5aa-43e3-8188-9dbddc4896c6 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:09.984899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8133-e5aa-43e3-8188-9dbddc4896c6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:09.985211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8133-e5aa-43e3-8188-9dbddc4896c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:09.986697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c8133-e5aa-43e3-8188-9dbddc4896c6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.027411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 259/511] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 23 10:37:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:10.028280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8133-e5aa-43e3-8188-9dbddc4896c6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:10.046228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:10.090053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43173524-6d25-4e42-ba6c-c58568d09521 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.126600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361faa3-e056-4d06-bec2-1cc731c43fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.127390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361faa3-e056-4d06-bec2-1cc731c43fbf None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.127676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361faa3-e056-4d06-bec2-1cc731c43fbf None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.127953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361faa3-e056-4d06-bec2-1cc731c43fbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.138911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361faa3-e056-4d06-bec2-1cc731c43fbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.140400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9361faa3-e056-4d06-bec2-1cc731c43fbf None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.144718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c8133-e5aa-43e3-8188-9dbddc4896c6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-9361faa3-e056-4d06-bec2-1cc731c43fbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:10.158863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:10.159899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:10.160760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:10.160760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:10.160760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:10.160760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:10.160760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 253/512] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:10.161023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361faa3-e056-4d06-bec2-1cc731c43fbf None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:10.184712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b4a0-a3b3-4279-8c54-3d6c000f211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.185667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b4a0-a3b3-4279-8c54-3d6c000f211f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.185805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b4a0-a3b3-4279-8c54-3d6c000f211f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.186090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2b4a0-a3b3-4279-8c54-3d6c000f211f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.197061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2b4a0-a3b3-4279-8c54-3d6c000f211f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.198607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2b4a0-a3b3-4279-8c54-3d6c000f211f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-89f2b4a0-a3b3-4279-8c54-3d6c000f211f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:10.216487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:10.217430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:10.218373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:10.218373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:10.218373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:10.218373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:10.218373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 260/513] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:10.219170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b4a0-a3b3-4279-8c54-3d6c000f211f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:10.255900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:10.267297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361faa3-e056-4d06-bec2-1cc731c43fbf None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.281257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:10.304308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e297249-8c8d-40df-b4f1-8fddd470126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.305579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e297249-8c8d-40df-b4f1-8fddd470126e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.305726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e297249-8c8d-40df-b4f1-8fddd470126e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.306019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e297249-8c8d-40df-b4f1-8fddd470126e None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.306813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e297249-8c8d-40df-b4f1-8fddd470126e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:10.307127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e297249-8c8d-40df-b4f1-8fddd470126e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.308507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e297249-8c8d-40df-b4f1-8fddd470126e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.320536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 254/514] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:10.321397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e297249-8c8d-40df-b4f1-8fddd470126e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:10.329325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2b4a0-a3b3-4279-8c54-3d6c000f211f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.365174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c06c-7260-4405-a6c1-467d8bb89ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.365846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c06c-7260-4405-a6c1-467d8bb89ad0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.366542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c06c-7260-4405-a6c1-467d8bb89ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.366835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8c06c-7260-4405-a6c1-467d8bb89ad0 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.368400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8c06c-7260-4405-a6c1-467d8bb89ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:10.368721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8c06c-7260-4405-a6c1-467d8bb89ad0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.370185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8c06c-7260-4405-a6c1-467d8bb89ad0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.387697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 261/515] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:10.388530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c06c-7260-4405-a6c1-467d8bb89ad0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:10.431897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e297249-8c8d-40df-b4f1-8fddd470126e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.467381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446ffed-4987-4401-aa98-495c85254ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.468040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ffed-4987-4401-aa98-495c85254ef8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.468322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ffed-4987-4401-aa98-495c85254ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.468605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ffed-4987-4401-aa98-495c85254ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.485252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:10.496586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8c06c-7260-4405-a6c1-467d8bb89ad0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.512845 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:10.537149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406ecf-8304-444a-8763-03ce7aefa0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.537817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406ecf-8304-444a-8763-03ce7aefa0d5 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.538107 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406ecf-8304-444a-8763-03ce7aefa0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.538421 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406ecf-8304-444a-8763-03ce7aefa0d5 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.540313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406ecf-8304-444a-8763-03ce7aefa0d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:10.540313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406ecf-8304-444a-8763-03ce7aefa0d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.541575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406ecf-8304-444a-8763-03ce7aefa0d5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.553809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 262/516] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:10.554767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406ecf-8304-444a-8763-03ce7aefa0d5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:10.561432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446ffed-4987-4401-aa98-495c85254ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.562983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446ffed-4987-4401-aa98-495c85254ef8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.662531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406ecf-8304-444a-8763-03ce7aefa0d5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.662733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 255/517] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:37:10.663421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446ffed-4987-4401-aa98-495c85254ef8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:10.700461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440670d-47a9-4849-94a6-0890e6f4bffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.701117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440670d-47a9-4849-94a6-0890e6f4bffc None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.701403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440670d-47a9-4849-94a6-0890e6f4bffc None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.701685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440670d-47a9-4849-94a6-0890e6f4bffc None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.702440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440670d-47a9-4849-94a6-0890e6f4bffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:10.702751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440670d-47a9-4849-94a6-0890e6f4bffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.704145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440670d-47a9-4849-94a6-0890e6f4bffc None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.716219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 263/518] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:10.717008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440670d-47a9-4849-94a6-0890e6f4bffc None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:10.728928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:10.735764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:10.765114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446ffed-4987-4401-aa98-495c85254ef8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.797561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac9629-4a5c-4692-bec6-0474dd0d4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.798370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac9629-4a5c-4692-bec6-0474dd0d4477 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.798659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac9629-4a5c-4692-bec6-0474dd0d4477 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.798969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac9629-4a5c-4692-bec6-0474dd0d4477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.806705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac9629-4a5c-4692-bec6-0474dd0d4477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.808305 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac9629-4a5c-4692-bec6-0474dd0d4477 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.816774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440670d-47a9-4849-94a6-0890e6f4bffc None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-7cac9629-4a5c-4692-bec6-0474dd0d4477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:10.823380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:10.824421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:10.825287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:10.825287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:10.825287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:10.825287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:10.825287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:10.825287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:10.825287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:10.825287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:10.825287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 256/519] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:10.825924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac9629-4a5c-4692-bec6-0474dd0d4477 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:10.856809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b299c1-d47d-40bd-9761-b54b67d24105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.857452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b299c1-d47d-40bd-9761-b54b67d24105 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.857735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b299c1-d47d-40bd-9761-b54b67d24105 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.858012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b299c1-d47d-40bd-9761-b54b67d24105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.927526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac9629-4a5c-4692-bec6-0474dd0d4477 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:10.931898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b299c1-d47d-40bd-9761-b54b67d24105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.933376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b299c1-d47d-40bd-9761-b54b67d24105 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.945028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:10.957880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:10.963400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db710-e04d-4977-81f2-6a5e9775a468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:10.964189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db710-e04d-4977-81f2-6a5e9775a468 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:10.964472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db710-e04d-4977-81f2-6a5e9775a468 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:10.964753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0db710-e04d-4977-81f2-6a5e9775a468 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:10.972351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0db710-e04d-4977-81f2-6a5e9775a468 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:10.973783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0db710-e04d-4977-81f2-6a5e9775a468 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-7e0db710-e04d-4977-81f2-6a5e9775a468 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:10.988381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:10.989485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:10.990466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 257/520] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:10.991036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db710-e04d-4977-81f2-6a5e9775a468 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:11.037953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 264/521] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:37:11.038820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b299c1-d47d-40bd-9761-b54b67d24105 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:11.089801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0db710-e04d-4977-81f2-6a5e9775a468 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:11.124776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7ec0-3320-486f-ba25-05ebd352b1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:11.125570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7ec0-3320-486f-ba25-05ebd352b1de None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:11.125855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7ec0-3320-486f-ba25-05ebd352b1de None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:11.126132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b7ec0-3320-486f-ba25-05ebd352b1de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:11.137437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b7ec0-3320-486f-ba25-05ebd352b1de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:11.138941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b7ec0-3320-486f-ba25-05ebd352b1de None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:11.139573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b299c1-d47d-40bd-9761-b54b67d24105 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:11.150261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-143b7ec0-3320-486f-ba25-05ebd352b1de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:11.156238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:11.157215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:11.158082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:11.158082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:11.158082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:11.158082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:11.158082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 258/522] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:11.158388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7ec0-3320-486f-ba25-05ebd352b1de None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:11.179483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195271b-19c6-4613-816c-dedd454632c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:11.180965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195271b-19c6-4613-816c-dedd454632c6 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:11.181336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195271b-19c6-4613-816c-dedd454632c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:11.181619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195271b-19c6-4613-816c-dedd454632c6 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:11.182344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195271b-19c6-4613-816c-dedd454632c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:11.183800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195271b-19c6-4613-816c-dedd454632c6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:11.204540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 265/523] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:37:11 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:11.205355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195271b-19c6-4613-816c-dedd454632c6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:11.216604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:11.282332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b7ec0-3320-486f-ba25-05ebd352b1de None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:11.318704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77e542-4831-450e-b25b-22b4710bbacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:11.319373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77e542-4831-450e-b25b-22b4710bbacb None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:11.319652 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77e542-4831-450e-b25b-22b4710bbacb None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:11.319935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77e542-4831-450e-b25b-22b4710bbacb None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:11.320913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77e542-4831-450e-b25b-22b4710bbacb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:11.321232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77e542-4831-450e-b25b-22b4710bbacb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:11.322784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77e542-4831-450e-b25b-22b4710bbacb None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:11.331915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195271b-19c6-4613-816c-dedd454632c6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:11.347701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 259/524] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:11.347701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77e542-4831-450e-b25b-22b4710bbacb None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:11.381278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce8c73-c42f-4465-b3f3-11d93035b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:11.382599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce8c73-c42f-4465-b3f3-11d93035b981 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:11.382599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce8c73-c42f-4465-b3f3-11d93035b981 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:11.382599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce8c73-c42f-4465-b3f3-11d93035b981 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:11.383576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce8c73-c42f-4465-b3f3-11d93035b981 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:11.383888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce8c73-c42f-4465-b3f3-11d93035b981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:11.385329 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce8c73-c42f-4465-b3f3-11d93035b981 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:11.406028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 266/525] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 23 10:37:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:11.406959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce8c73-c42f-4465-b3f3-11d93035b981 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:11.436144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:11.482381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77e542-4831-450e-b25b-22b4710bbacb None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:11.485655 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:11.535425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07ad9a-83bd-4d83-b185-ef958de3effd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:11.535425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07ad9a-83bd-4d83-b185-ef958de3effd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:11.535795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07ad9a-83bd-4d83-b185-ef958de3effd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:11.536017 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07ad9a-83bd-4d83-b185-ef958de3effd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:11.546449 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce8c73-c42f-4465-b3f3-11d93035b981 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:11.552215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07ad9a-83bd-4d83-b185-ef958de3effd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:11.553957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07ad9a-83bd-4d83-b185-ef958de3effd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-de07ad9a-83bd-4d83-b185-ef958de3effd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:11.575911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:11.576853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:11.577790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:11.577790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:11.577790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:11.577790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:11.577790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 260/526] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:11.578072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07ad9a-83bd-4d83-b185-ef958de3effd None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:11.605144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d35c1-ef6f-4891-8ef8-b9d0c48e5411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:11.606305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d35c1-ef6f-4891-8ef8-b9d0c48e5411 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:11.607205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d35c1-ef6f-4891-8ef8-b9d0c48e5411 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:11.607328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d35c1-ef6f-4891-8ef8-b9d0c48e5411 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:11.608690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d35c1-ef6f-4891-8ef8-b9d0c48e5411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:11.609387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d35c1-ef6f-4891-8ef8-b9d0c48e5411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:11.611831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d35c1-ef6f-4891-8ef8-b9d0c48e5411 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:11.639639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 267/527] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:11.639639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d35c1-ef6f-4891-8ef8-b9d0c48e5411 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:11.733975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07ad9a-83bd-4d83-b185-ef958de3effd None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:11.750887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:11.776286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d35c1-ef6f-4891-8ef8-b9d0c48e5411 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:11.778247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b150a-6eb8-4ac7-a688-98897e36e972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:11.778933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b150a-6eb8-4ac7-a688-98897e36e972 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:11.779217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b150a-6eb8-4ac7-a688-98897e36e972 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:11.779493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b150a-6eb8-4ac7-a688-98897e36e972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:11.780351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b150a-6eb8-4ac7-a688-98897e36e972 None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=0d639e845cfa4f10b8e86cd237664c9b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:11.780662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b150a-6eb8-4ac7-a688-98897e36e972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:11.782115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b150a-6eb8-4ac7-a688-98897e36e972 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:11.788780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 261/528] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:11 2022] GET /identity/v3/role_assignments?user.id=0d639e845cfa4f10b8e86cd237664c9b&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:11.789353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b150a-6eb8-4ac7-a688-98897e36e972 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:11.823623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:11.837972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf084c3-9f15-4e31-affa-7f5c71c390a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:11.838915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf084c3-9f15-4e31-affa-7f5c71c390a0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:11.839733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf084c3-9f15-4e31-affa-7f5c71c390a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:11.839879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf084c3-9f15-4e31-affa-7f5c71c390a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:11.928805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf084c3-9f15-4e31-affa-7f5c71c390a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:11.931792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf084c3-9f15-4e31-affa-7f5c71c390a0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:11.942072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b150a-6eb8-4ac7-a688-98897e36e972 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:11.993962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c6c1b-4b03-4bb7-9f61-71b1704f20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:11.994668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c6c1b-4b03-4bb7-9f61-71b1704f20b2 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:11.994954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c6c1b-4b03-4bb7-9f61-71b1704f20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:11.995232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c6c1b-4b03-4bb7-9f61-71b1704f20b2 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:11.995972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c6c1b-4b03-4bb7-9f61-71b1704f20b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:11.996279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c6c1b-4b03-4bb7-9f61-71b1704f20b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:11.997666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c6c1b-4b03-4bb7-9f61-71b1704f20b2 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:12.015513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 262/529] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:12.016534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c6c1b-4b03-4bb7-9f61-71b1704f20b2 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:12.070137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:12.090656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 268/530] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:37:12.091684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf084c3-9f15-4e31-affa-7f5c71c390a0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:12.134666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:12.161292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c6c1b-4b03-4bb7-9f61-71b1704f20b2 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:12.207636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59db83-f5cd-4d3a-b3ae-ba7352abfb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:12.208895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59db83-f5cd-4d3a-b3ae-ba7352abfb4b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:12.209600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59db83-f5cd-4d3a-b3ae-ba7352abfb4b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:12.210021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59db83-f5cd-4d3a-b3ae-ba7352abfb4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:12.217426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf084c3-9f15-4e31-affa-7f5c71c390a0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:12.221210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59db83-f5cd-4d3a-b3ae-ba7352abfb4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:12.222925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59db83-f5cd-4d3a-b3ae-ba7352abfb4b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-0c59db83-f5cd-4d3a-b3ae-ba7352abfb4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:12.241406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:12.243010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:12.244201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:12.244201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:12.244201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:12.244201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:12.244201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:12.244201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:12.244201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:12.244201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:12.253183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 263/531] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:12.253183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59db83-f5cd-4d3a-b3ae-ba7352abfb4b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:12.269285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c0899-3144-4759-bc56-ae390c390609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:12.270088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c0899-3144-4759-bc56-ae390c390609 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:12.270407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c0899-3144-4759-bc56-ae390c390609 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:12.270927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c0899-3144-4759-bc56-ae390c390609 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:12.278275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c0899-3144-4759-bc56-ae390c390609 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:12.279903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c0899-3144-4759-bc56-ae390c390609 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-bf4c0899-3144-4759-bc56-ae390c390609 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:12.298844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:12.300103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:12.301320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:12.301320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:12.301320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:12.301320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:12.301320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:12.301320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:12.301320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:12.301320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:12.305378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 269/532] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:12.306338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c0899-3144-4759-bc56-ae390c390609 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:12.380265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:12.398725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59db83-f5cd-4d3a-b3ae-ba7352abfb4b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:12.452080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9061ef-4703-4587-b850-daffabeea393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:12.453634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9061ef-4703-4587-b850-daffabeea393 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:12.455203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9061ef-4703-4587-b850-daffabeea393 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:12.455837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9061ef-4703-4587-b850-daffabeea393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:12.461845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c0899-3144-4759-bc56-ae390c390609 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:12.469327 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:12.472395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9061ef-4703-4587-b850-daffabeea393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:12.474536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9061ef-4703-4587-b850-daffabeea393 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-6d9061ef-4703-4587-b850-daffabeea393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:12.496437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:12.497567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:12.498658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:12.498658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:12.498658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:12.498658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:12.499884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 264/533] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:12.500942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9061ef-4703-4587-b850-daffabeea393 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:12.512558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9b456-2b14-40da-a3c9-4cdf97d7854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:12.513947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9b456-2b14-40da-a3c9-4cdf97d7854e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:12.514418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9b456-2b14-40da-a3c9-4cdf97d7854e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:12.514834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9b456-2b14-40da-a3c9-4cdf97d7854e None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:12.516444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9b456-2b14-40da-a3c9-4cdf97d7854e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:12.519700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9b456-2b14-40da-a3c9-4cdf97d7854e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:12.520217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c9b456-2b14-40da-a3c9-4cdf97d7854e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:12.557552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 270/534] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:12.557552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9b456-2b14-40da-a3c9-4cdf97d7854e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:12.646667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9061ef-4703-4587-b850-daffabeea393 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:12.682022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9b456-2b14-40da-a3c9-4cdf97d7854e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:12.685415 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:12.696286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb356f46-38df-48b5-81a1-7b39e508d5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:12.697677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb356f46-38df-48b5-81a1-7b39e508d5dc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:12.698434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb356f46-38df-48b5-81a1-7b39e508d5dc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:12.698937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb356f46-38df-48b5-81a1-7b39e508d5dc None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:12.700236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb356f46-38df-48b5-81a1-7b39e508d5dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:12.701220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb356f46-38df-48b5-81a1-7b39e508d5dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:12.703469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb356f46-38df-48b5-81a1-7b39e508d5dc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:12.720634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 265/535] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:12.721781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb356f46-38df-48b5-81a1-7b39e508d5dc None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:12.728317 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40469c-cf09-489a-908c-ca6a722ad84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:12.729308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40469c-cf09-489a-908c-ca6a722ad84f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:12.729812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40469c-cf09-489a-908c-ca6a722ad84f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:12.730374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40469c-cf09-489a-908c-ca6a722ad84f None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:12.731315 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40469c-cf09-489a-908c-ca6a722ad84f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:12.732437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40469c-cf09-489a-908c-ca6a722ad84f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:12.734504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40469c-cf09-489a-908c-ca6a722ad84f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:12.751929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 271/536] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:12.753366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40469c-cf09-489a-908c-ca6a722ad84f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:12.783858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:12.847733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb356f46-38df-48b5-81a1-7b39e508d5dc None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:12.883564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40469c-cf09-489a-908c-ca6a722ad84f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:12.895446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27215ebb-2e79-480d-bd77-10404496e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:12.896115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27215ebb-2e79-480d-bd77-10404496e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:12.896396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27215ebb-2e79-480d-bd77-10404496e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:12.896685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27215ebb-2e79-480d-bd77-10404496e5f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:12.897621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27215ebb-2e79-480d-bd77-10404496e5f1 None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=0930d783a2574d5caeb2587fe4157cf8) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:12.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27215ebb-2e79-480d-bd77-10404496e5f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:12.900753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27215ebb-2e79-480d-bd77-10404496e5f1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:12.914674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 266/537] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:12 2022] GET /identity/v3/role_assignments?user.id=0930d783a2574d5caeb2587fe4157cf8&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:12.915741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27215ebb-2e79-480d-bd77-10404496e5f1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:12.932159 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e34e-67bd-4b50-9328-b2301307083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:12.933178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e34e-67bd-4b50-9328-b2301307083e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:12.933674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e34e-67bd-4b50-9328-b2301307083e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:12.934161 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e34e-67bd-4b50-9328-b2301307083e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:12.935242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e34e-67bd-4b50-9328-b2301307083e None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=33a1696d1cc14ca6ac1cb970598f11fa) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:12.935750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e34e-67bd-4b50-9328-b2301307083e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:12.938275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e34e-67bd-4b50-9328-b2301307083e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:12.947227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 272/538] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:12 2022] GET /identity/v3/role_assignments?user.id=33a1696d1cc14ca6ac1cb970598f11fa&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:13.100827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27215ebb-2e79-480d-bd77-10404496e5f1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:13.123024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:13.145408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828061e-308d-4ba8-a2d6-07f1ce6139f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:13.146203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828061e-308d-4ba8-a2d6-07f1ce6139f0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:13.146510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828061e-308d-4ba8-a2d6-07f1ce6139f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:13.146917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828061e-308d-4ba8-a2d6-07f1ce6139f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:13.156054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828061e-308d-4ba8-a2d6-07f1ce6139f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:13.157532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828061e-308d-4ba8-a2d6-07f1ce6139f0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-8828061e-308d-4ba8-a2d6-07f1ce6139f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:13.173557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:13.174522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:13.175367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:13.175367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:13.175367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:13.175367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:13.175367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:13.175367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:13.175367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:13.175367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:13.175367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 267/539] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:13.181464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e34e-67bd-4b50-9328-b2301307083e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:13.217723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:13.295589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e34e-67bd-4b50-9328-b2301307083e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:13.332129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f685078-9dc7-4e94-a3ee-15d2abba7cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:13.333162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f685078-9dc7-4e94-a3ee-15d2abba7cec None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:13.333645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f685078-9dc7-4e94-a3ee-15d2abba7cec None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:13.334133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f685078-9dc7-4e94-a3ee-15d2abba7cec None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:13.335147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f685078-9dc7-4e94-a3ee-15d2abba7cec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:13.335652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f685078-9dc7-4e94-a3ee-15d2abba7cec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:13.338186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f685078-9dc7-4e94-a3ee-15d2abba7cec None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:13.353250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 273/540] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:13.359192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828061e-308d-4ba8-a2d6-07f1ce6139f0 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:13.533013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828061e-308d-4ba8-a2d6-07f1ce6139f0 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:13.541463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ad4bd-786f-48b5-8cd7-5a3fb0b10494 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:13.542524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ad4bd-786f-48b5-8cd7-5a3fb0b10494 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:13.543024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ad4bd-786f-48b5-8cd7-5a3fb0b10494 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:13.545882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 274/541] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:13.556155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ce84c-e784-4e91-a3a7-026d74f050aa None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:13.556533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ce84c-e784-4e91-a3a7-026d74f050aa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:13.556826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ce84c-e784-4e91-a3a7-026d74f050aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:13.588821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7b6ce84c-e784-4e91-a3a7-026d74f050aa None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:13.590067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7b6ce84c-e784-4e91-a3a7-026d74f050aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:13.592858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddf89a-8448-4fa1-a133-2b3bde576e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:13.593530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddf89a-8448-4fa1-a133-2b3bde576e54 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:13.593815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddf89a-8448-4fa1-a133-2b3bde576e54 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:13.594096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddf89a-8448-4fa1-a133-2b3bde576e54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:13.594980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddf89a-8448-4fa1-a133-2b3bde576e54 None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=ed8f21a950d6483abc7ab67fb533942a) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:13.595299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddf89a-8448-4fa1-a133-2b3bde576e54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:13.597725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddf89a-8448-4fa1-a133-2b3bde576e54 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:13.613180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 268/542] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:13 2022] GET /identity/v3/role_assignments?user.id=ed8f21a950d6483abc7ab67fb533942a&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:13.710751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 275/543] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:37:13.760517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddf89a-8448-4fa1-a133-2b3bde576e54 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:13.826107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:13.905610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddf89a-8448-4fa1-a133-2b3bde576e54 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:13.956142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec60e78-4100-4ed9-a7f5-cf768a8b87b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:13.957293 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec60e78-4100-4ed9-a7f5-cf768a8b87b0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:13.957851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec60e78-4100-4ed9-a7f5-cf768a8b87b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:13.958347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec60e78-4100-4ed9-a7f5-cf768a8b87b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:13.971801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec60e78-4100-4ed9-a7f5-cf768a8b87b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-cec60e78-4100-4ed9-a7f5-cf768a8b87b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:13.980723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:13.981659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:13.982561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:13.986082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 269/544] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:13.994735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ce84c-e784-4e91-a3a7-026d74f050aa None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:14.033652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:14.113123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859298-3d14-4b33-841b-e10c27ba1417 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:14.113123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859298-3d14-4b33-841b-e10c27ba1417 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:14.113123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd859298-3d14-4b33-841b-e10c27ba1417 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:14.121398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 270/545] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:37:14.123795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891ddcb-ea3a-4691-9f93-ce2ab35a50c4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:14.124298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891ddcb-ea3a-4691-9f93-ce2ab35a50c4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:14.124763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891ddcb-ea3a-4691-9f93-ce2ab35a50c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:14.158381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-b891ddcb-ea3a-4691-9f93-ce2ab35a50c4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:14.159538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b891ddcb-ea3a-4691-9f93-ce2ab35a50c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:14.186876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ce84c-e784-4e91-a3a7-026d74f050aa None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:14.239763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d9ea-92db-4e08-badf-f3d7b9c6999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:14.240443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d9ea-92db-4e08-badf-f3d7b9c6999e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:14.240733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d9ea-92db-4e08-badf-f3d7b9c6999e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:14.241014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d9ea-92db-4e08-badf-f3d7b9c6999e None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:14.241777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0d9ea-92db-4e08-badf-f3d7b9c6999e None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:14.242089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0d9ea-92db-4e08-badf-f3d7b9c6999e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:14.244849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0d9ea-92db-4e08-badf-f3d7b9c6999e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:14.272552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 276/546] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:14.278663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d9ea-92db-4e08-badf-f3d7b9c6999e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:14.297386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 271/547] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:37:14.360437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891ddcb-ea3a-4691-9f93-ce2ab35a50c4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:14.402028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:14.430413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d9ea-92db-4e08-badf-f3d7b9c6999e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:14.436378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:14.504019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1728c-ecec-4384-843a-988ad6d15b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:14.504827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1728c-ecec-4384-843a-988ad6d15b3a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:14.505110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1728c-ecec-4384-843a-988ad6d15b3a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:14.505388 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1728c-ecec-4384-843a-988ad6d15b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:14.521776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1728c-ecec-4384-843a-988ad6d15b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:14.523306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1728c-ecec-4384-843a-988ad6d15b3a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-0ef1728c-ecec-4384-843a-988ad6d15b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:14.551659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:14.553047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:14.553957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:14.553957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:14.553957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:14.553957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:14.554192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 277/548] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:14.559330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1728c-ecec-4384-843a-988ad6d15b3a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:14.574233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891ddcb-ea3a-4691-9f93-ce2ab35a50c4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:14.648140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd31b-53fb-4abf-9205-a2fc56cf390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:14.649253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd31b-53fb-4abf-9205-a2fc56cf390d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:14.649527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd31b-53fb-4abf-9205-a2fc56cf390d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:14.649809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cd31b-53fb-4abf-9205-a2fc56cf390d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:14.672498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cd31b-53fb-4abf-9205-a2fc56cf390d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-280cd31b-53fb-4abf-9205-a2fc56cf390d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:14.680915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:14.681888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:14.683321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 272/549] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:14.692584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd31b-53fb-4abf-9205-a2fc56cf390d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:14.749765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1728c-ecec-4384-843a-988ad6d15b3a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:14.782445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:14.789851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3cc26-72c6-4e90-9bec-84004a90ce17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:14.790553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3cc26-72c6-4e90-9bec-84004a90ce17 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:14.790942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3cc26-72c6-4e90-9bec-84004a90ce17 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:14.791232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3cc26-72c6-4e90-9bec-84004a90ce17 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:14.792079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3cc26-72c6-4e90-9bec-84004a90ce17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:14.792397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3cc26-72c6-4e90-9bec-84004a90ce17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:14.793834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3cc26-72c6-4e90-9bec-84004a90ce17 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:14.808121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 278/550] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:14.814133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3cc26-72c6-4e90-9bec-84004a90ce17 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:14.846556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:14.864051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cd31b-53fb-4abf-9205-a2fc56cf390d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:14.935584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788325ff-19a0-43c5-9e4d-2cc4a577bb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:14.936205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788325ff-19a0-43c5-9e4d-2cc4a577bb80 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:14.936459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788325ff-19a0-43c5-9e4d-2cc4a577bb80 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:14.936736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788325ff-19a0-43c5-9e4d-2cc4a577bb80 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:14.937493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788325ff-19a0-43c5-9e4d-2cc4a577bb80 None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:14.937849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788325ff-19a0-43c5-9e4d-2cc4a577bb80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:14.939212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788325ff-19a0-43c5-9e4d-2cc4a577bb80 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:14.962735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 273/551] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:14.975401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788325ff-19a0-43c5-9e4d-2cc4a577bb80 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:14.986409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3cc26-72c6-4e90-9bec-84004a90ce17 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:15.051003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731ed20-6fc9-400e-b44d-d325b845ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:15.051806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731ed20-6fc9-400e-b44d-d325b845ec49 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.052086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731ed20-6fc9-400e-b44d-d325b845ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.052357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731ed20-6fc9-400e-b44d-d325b845ec49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.064391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731ed20-6fc9-400e-b44d-d325b845ec49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:15.066144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731ed20-6fc9-400e-b44d-d325b845ec49 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-1731ed20-6fc9-400e-b44d-d325b845ec49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:15.090229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:15.091453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:15.092793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:15.099998 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 279/552] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:15.104805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731ed20-6fc9-400e-b44d-d325b845ec49 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:15.164226 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788325ff-19a0-43c5-9e4d-2cc4a577bb80 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:15.206374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a42e3-0bae-4174-907f-5cdcdd3a9227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:15.207323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a42e3-0bae-4174-907f-5cdcdd3a9227 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.207605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a42e3-0bae-4174-907f-5cdcdd3a9227 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.207886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a42e3-0bae-4174-907f-5cdcdd3a9227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.221763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a42e3-0bae-4174-907f-5cdcdd3a9227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:15.223268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a42e3-0bae-4174-907f-5cdcdd3a9227 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-6b2a42e3-0bae-4174-907f-5cdcdd3a9227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:15.246433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:15.247418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:15.248290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:15.248290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:15.248290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:15.248290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:15.248610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 274/553] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:15.254564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a42e3-0bae-4174-907f-5cdcdd3a9227 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:15.262685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:15.282702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:15.380015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a42e3-0bae-4174-907f-5cdcdd3a9227 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:15.420506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b20aa-9eb4-418a-b86a-27b3a74eccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:15.421173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b20aa-9eb4-418a-b86a-27b3a74eccf3 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.421454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b20aa-9eb4-418a-b86a-27b3a74eccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.421737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b20aa-9eb4-418a-b86a-27b3a74eccf3 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.422559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b20aa-9eb4-418a-b86a-27b3a74eccf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:15.422870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b20aa-9eb4-418a-b86a-27b3a74eccf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:15.425094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b20aa-9eb4-418a-b86a-27b3a74eccf3 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:15.440045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 275/554] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:15.445609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b20aa-9eb4-418a-b86a-27b3a74eccf3 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:15.448581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731ed20-6fc9-400e-b44d-d325b845ec49 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:15.535024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:15.563728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81603ba-d0e4-4387-a530-45d7edb3bccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:15.564542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81603ba-d0e4-4387-a530-45d7edb3bccf None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.564679 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81603ba-d0e4-4387-a530-45d7edb3bccf None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.565284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81603ba-d0e4-4387-a530-45d7edb3bccf None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.566059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81603ba-d0e4-4387-a530-45d7edb3bccf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:15.566392 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81603ba-d0e4-4387-a530-45d7edb3bccf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:15.568715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81603ba-d0e4-4387-a530-45d7edb3bccf None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:15.606353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 280/555] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 23 10:37:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:15.608635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b20aa-9eb4-418a-b86a-27b3a74eccf3 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:15.615373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81603ba-d0e4-4387-a530-45d7edb3bccf None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:15.670622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff72a2f-8199-4a9a-a8e7-3ef96ca9dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:15.671446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72a2f-8199-4a9a-a8e7-3ef96ca9dedc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.671728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72a2f-8199-4a9a-a8e7-3ef96ca9dedc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.672008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff72a2f-8199-4a9a-a8e7-3ef96ca9dedc None admin] PATH_INFO: `/v3/users/nova` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.680291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff72a2f-8199-4a9a-a8e7-3ef96ca9dedc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:15.681805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff72a2f-8199-4a9a-a8e7-3ef96ca9dedc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-fff72a2f-8199-4a9a-a8e7-3ef96ca9dedc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:15.698419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:15.699545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 276/556] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 23 10:37:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:15.700954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591230-4a0e-4075-b8e1-0783a94666f2 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.701633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591230-4a0e-4075-b8e1-0783a94666f2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.701633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17591230-4a0e-4075-b8e1-0783a94666f2 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.707396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 277/557] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:15.707396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386417-3a3c-4cd6-bed3-207c9ae3a446 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.707396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386417-3a3c-4cd6-bed3-207c9ae3a446 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.707396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386417-3a3c-4cd6-bed3-207c9ae3a446 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.707396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 278/558] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:15.707396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386417-3a3c-4cd6-bed3-207c9ae3a446 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:15.748302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81603ba-d0e4-4387-a530-45d7edb3bccf None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:15.763029 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:15.794054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64451a-c8f4-4c23-aa99-b9fee810c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:15.794655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64451a-c8f4-4c23-aa99-b9fee810c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.794923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64451a-c8f4-4c23-aa99-b9fee810c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.795197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64451a-c8f4-4c23-aa99-b9fee810c2c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.826912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75386417-3a3c-4cd6-bed3-207c9ae3a446 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:15.854164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:15.867725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aca75-0d37-494f-aece-467d8a42fb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:15.868403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aca75-0d37-494f-aece-467d8a42fb68 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.868690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aca75-0d37-494f-aece-467d8a42fb68 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.868976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aca75-0d37-494f-aece-467d8a42fb68 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.869832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aca75-0d37-494f-aece-467d8a42fb68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:15.870147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aca75-0d37-494f-aece-467d8a42fb68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:15.871628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5aca75-0d37-494f-aece-467d8a42fb68 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:15.885457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64451a-c8f4-4c23-aa99-b9fee810c2c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:15.887730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64451a-c8f4-4c23-aa99-b9fee810c2c8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:15.893435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 279/559] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 23 10:37:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:15.895026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47069185-07e4-487c-aa9b-cf4ca8afba39 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.895109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47069185-07e4-487c-aa9b-cf4ca8afba39 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.895336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47069185-07e4-487c-aa9b-cf4ca8afba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:15.913727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-47069185-07e4-487c-aa9b-cf4ca8afba39 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:15.915578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-47069185-07e4-487c-aa9b-cf4ca8afba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:15.997549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 280/560] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:15.997549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37487f10-bfaf-43c1-b96a-365d9ea38f8c None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:15.997549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37487f10-bfaf-43c1-b96a-365d9ea38f8c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:15.997549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37487f10-bfaf-43c1-b96a-365d9ea38f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.011261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-37487f10-bfaf-43c1-b96a-365d9ea38f8c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:16.012449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-37487f10-bfaf-43c1-b96a-365d9ea38f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:16.015051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 281/561] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:37:16.015912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64451a-c8f4-4c23-aa99-b9fee810c2c8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.029735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:16.098362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 281/562] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:16.098362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37487f10-bfaf-43c1-b96a-365d9ea38f8c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.146225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64451a-c8f4-4c23-aa99-b9fee810c2c8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.147117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:16.183028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b53abe-0234-4258-bcdc-cf5f43c0125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.183823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53abe-0234-4258-bcdc-cf5f43c0125c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.184104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53abe-0234-4258-bcdc-cf5f43c0125c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.184377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53abe-0234-4258-bcdc-cf5f43c0125c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.195028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b53abe-0234-4258-bcdc-cf5f43c0125c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:16.197118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b53abe-0234-4258-bcdc-cf5f43c0125c None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:16.215427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37487f10-bfaf-43c1-b96a-365d9ea38f8c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-55b53abe-0234-4258-bcdc-cf5f43c0125c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:16.216300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:16.217196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:16.218086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:16.218086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:16.218086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:16.218086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:16.218086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 282/563] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:16.218487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b53abe-0234-4258-bcdc-cf5f43c0125c None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.254276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db9708-7ca0-46aa-8e2c-3e304a553020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.255096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db9708-7ca0-46aa-8e2c-3e304a553020 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.255380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db9708-7ca0-46aa-8e2c-3e304a553020 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.255656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db9708-7ca0-46aa-8e2c-3e304a553020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.267045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db9708-7ca0-46aa-8e2c-3e304a553020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:16.268177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db9708-7ca0-46aa-8e2c-3e304a553020 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-a8db9708-7ca0-46aa-8e2c-3e304a553020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:16.287534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:16.288526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:16.289516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:16.289516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:16.289516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:16.289516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:16.289516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 282/564] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:16.289813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db9708-7ca0-46aa-8e2c-3e304a553020 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.293797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:16.333694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b53abe-0234-4258-bcdc-cf5f43c0125c None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.368355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d9360-1404-4c8f-b7c7-5283537997a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.369077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d9360-1404-4c8f-b7c7-5283537997a3 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.369365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d9360-1404-4c8f-b7c7-5283537997a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.369649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d9360-1404-4c8f-b7c7-5283537997a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.379835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d9360-1404-4c8f-b7c7-5283537997a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-1b1d9360-1404-4c8f-b7c7-5283537997a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:16.388141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:16.389154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:16.390019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 283/565] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:16.390793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d9360-1404-4c8f-b7c7-5283537997a3 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.393351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:16.401097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db9708-7ca0-46aa-8e2c-3e304a553020 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.438216 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1510d4-1c6b-4bb3-960c-00127875d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.439073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1510d4-1c6b-4bb3-960c-00127875d671 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.439362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1510d4-1c6b-4bb3-960c-00127875d671 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.439640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1510d4-1c6b-4bb3-960c-00127875d671 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.450704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1510d4-1c6b-4bb3-960c-00127875d671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-fe1510d4-1c6b-4bb3-960c-00127875d671 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:16.458417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:16.459336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:16.460184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 283/566] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:16.461396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1510d4-1c6b-4bb3-960c-00127875d671 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.499926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d9360-1404-4c8f-b7c7-5283537997a3 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.523187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:16.535183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc07267-8ba3-4af5-8fdf-90046f694fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.535847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc07267-8ba3-4af5-8fdf-90046f694fab None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.536133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc07267-8ba3-4af5-8fdf-90046f694fab None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.536413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc07267-8ba3-4af5-8fdf-90046f694fab None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.537149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc07267-8ba3-4af5-8fdf-90046f694fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:16.537465 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc07267-8ba3-4af5-8fdf-90046f694fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:16.538921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc07267-8ba3-4af5-8fdf-90046f694fab None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:16.551632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 284/567] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:16.552938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2c448-8fcd-4e04-9a7f-7d54fe9a8ea8 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.553232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2c448-8fcd-4e04-9a7f-7d54fe9a8ea8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.553517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2c448-8fcd-4e04-9a7f-7d54fe9a8ea8 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.555083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 285/568] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:16.555499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2c448-8fcd-4e04-9a7f-7d54fe9a8ea8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.569970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1510d4-1c6b-4bb3-960c-00127875d671 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.605519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f2af-8da2-4e79-81e5-9669bea2ca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.606175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f2af-8da2-4e79-81e5-9669bea2ca2f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.606488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f2af-8da2-4e79-81e5-9669bea2ca2f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.606769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683f2af-8da2-4e79-81e5-9669bea2ca2f None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.607492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f2af-8da2-4e79-81e5-9669bea2ca2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:16.607806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f2af-8da2-4e79-81e5-9669bea2ca2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:16.609168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683f2af-8da2-4e79-81e5-9669bea2ca2f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:16.620943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 284/569] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:16.621672 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f2af-8da2-4e79-81e5-9669bea2ca2f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.636232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:16.663674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2c448-8fcd-4e04-9a7f-7d54fe9a8ea8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.698891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401303d-208a-468e-a33c-275ec074885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.699544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401303d-208a-468e-a33c-275ec074885b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.699825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401303d-208a-468e-a33c-275ec074885b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.700100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401303d-208a-468e-a33c-275ec074885b None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.700836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401303d-208a-468e-a33c-275ec074885b None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:16.701141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401303d-208a-468e-a33c-275ec074885b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:16.702522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401303d-208a-468e-a33c-275ec074885b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:16.710829 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 286/570] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:16.712542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402de16-356b-4934-9e5b-199d78c67138 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.712830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402de16-356b-4934-9e5b-199d78c67138 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.713111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402de16-356b-4934-9e5b-199d78c67138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.720640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683f2af-8da2-4e79-81e5-9669bea2ca2f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.729504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-4402de16-356b-4934-9e5b-199d78c67138 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:16.730715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4402de16-356b-4934-9e5b-199d78c67138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:16.754545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407652b-96a7-4adc-9150-542490266041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.755204 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407652b-96a7-4adc-9150-542490266041 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.755489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407652b-96a7-4adc-9150-542490266041 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.755783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407652b-96a7-4adc-9150-542490266041 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.756512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407652b-96a7-4adc-9150-542490266041 None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:16.756819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407652b-96a7-4adc-9150-542490266041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:16.758432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407652b-96a7-4adc-9150-542490266041 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:16.766442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 285/571] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:16.767242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407652b-96a7-4adc-9150-542490266041 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.769165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:16.798969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 287/572] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:16.799733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402de16-356b-4934-9e5b-199d78c67138 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.848201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:16.870813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407652b-96a7-4adc-9150-542490266041 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.902791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402de16-356b-4934-9e5b-199d78c67138 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:16.904615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71d02-a693-4d1f-bb24-8e68273b9241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.905401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71d02-a693-4d1f-bb24-8e68273b9241 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.905725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71d02-a693-4d1f-bb24-8e68273b9241 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.906002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71d02-a693-4d1f-bb24-8e68273b9241 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.912855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71d02-a693-4d1f-bb24-8e68273b9241 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:16.914922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71d02-a693-4d1f-bb24-8e68273b9241 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-edf71d02-a693-4d1f-bb24-8e68273b9241 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:16.931203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:16.932127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:16.933104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:16.933104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:16.933104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:16.933104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:16.933104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:16.933104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:16.933104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:16.933104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:16.933104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 286/573] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:16.933616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71d02-a693-4d1f-bb24-8e68273b9241 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:16.942452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cebe20-16e0-491e-8344-83a8bca2fd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:16.943250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cebe20-16e0-491e-8344-83a8bca2fd4d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:16.943535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cebe20-16e0-491e-8344-83a8bca2fd4d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:16.943811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cebe20-16e0-491e-8344-83a8bca2fd4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:16.950902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cebe20-16e0-491e-8344-83a8bca2fd4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:16.952371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cebe20-16e0-491e-8344-83a8bca2fd4d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-11cebe20-16e0-491e-8344-83a8bca2fd4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:16.965942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:16.966910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:16.967798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:16.967798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:16.967798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:16.967798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:16.967798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:16.967798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:16.967798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:16.967798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:16.967798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 288/574] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:16.968282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cebe20-16e0-491e-8344-83a8bca2fd4d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.004611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:17.047345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71d02-a693-4d1f-bb24-8e68273b9241 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.075578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cebe20-16e0-491e-8344-83a8bca2fd4d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.085343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b4a15-0a59-49ff-821b-8e1f896fc6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.086958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b4a15-0a59-49ff-821b-8e1f896fc6b4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.087247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b4a15-0a59-49ff-821b-8e1f896fc6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.087533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b4a15-0a59-49ff-821b-8e1f896fc6b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.090665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:17.101087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b4a15-0a59-49ff-821b-8e1f896fc6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:17.103666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b4a15-0a59-49ff-821b-8e1f896fc6b4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:17.111479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d210-2b6d-427c-adb8-f674756c1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.112265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d210-2b6d-427c-adb8-f674756c1f0a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.112550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d210-2b6d-427c-adb8-f674756c1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.115966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d210-2b6d-427c-adb8-f674756c1f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-f30b4a15-0a59-49ff-821b-8e1f896fc6b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:17.125145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:17.126089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:17.127067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:17.127067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:17.127067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:17.127067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:17.127067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 287/575] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:17.127856 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b4a15-0a59-49ff-821b-8e1f896fc6b4 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.132401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69d210-2b6d-427c-adb8-f674756c1f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:17.134193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69d210-2b6d-427c-adb8-f674756c1f0a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-fc69d210-2b6d-427c-adb8-f674756c1f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:17.152252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:17.153387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:17.154342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:17.154342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:17.154342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:17.154342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:17.154342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 289/576] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:17.154342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d210-2b6d-427c-adb8-f674756c1f0a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.243253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b4a15-0a59-49ff-821b-8e1f896fc6b4 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.254804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:17.271841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d210-2b6d-427c-adb8-f674756c1f0a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.279609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999d0f4-e0a0-4620-b264-72c48d0955df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.280426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999d0f4-e0a0-4620-b264-72c48d0955df None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.280721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999d0f4-e0a0-4620-b264-72c48d0955df None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.281015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999d0f4-e0a0-4620-b264-72c48d0955df None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.292065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999d0f4-e0a0-4620-b264-72c48d0955df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-f999d0f4-e0a0-4620-b264-72c48d0955df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:17.299809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:17.300896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:17.301768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 288/577] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:17.303137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999d0f4-e0a0-4620-b264-72c48d0955df None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.317472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911869c8-5c46-4c2d-98ab-bb2c2fe1d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.318143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911869c8-5c46-4c2d-98ab-bb2c2fe1d446 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.318463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911869c8-5c46-4c2d-98ab-bb2c2fe1d446 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.318755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911869c8-5c46-4c2d-98ab-bb2c2fe1d446 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.319555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911869c8-5c46-4c2d-98ab-bb2c2fe1d446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:17.319870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911869c8-5c46-4c2d-98ab-bb2c2fe1d446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:17.321476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911869c8-5c46-4c2d-98ab-bb2c2fe1d446 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:17.334753 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 290/578] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:17.335641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911869c8-5c46-4c2d-98ab-bb2c2fe1d446 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.353582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:17.406037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999d0f4-e0a0-4620-b264-72c48d0955df None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.442190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34c820-9826-4b59-828d-68b0b7f0ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.443099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34c820-9826-4b59-828d-68b0b7f0ca9c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.443391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34c820-9826-4b59-828d-68b0b7f0ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.443672 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34c820-9826-4b59-828d-68b0b7f0ca9c None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.444471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34c820-9826-4b59-828d-68b0b7f0ca9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:17.444787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34c820-9826-4b59-828d-68b0b7f0ca9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:17.447008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34c820-9826-4b59-828d-68b0b7f0ca9c None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:17.450163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911869c8-5c46-4c2d-98ab-bb2c2fe1d446 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.459573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 289/579] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:17.460634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34c820-9826-4b59-828d-68b0b7f0ca9c None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.485703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30ae36-4af1-4169-947c-ffb033c6ff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.486394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30ae36-4af1-4169-947c-ffb033c6ff85 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.486684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30ae36-4af1-4169-947c-ffb033c6ff85 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.486965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30ae36-4af1-4169-947c-ffb033c6ff85 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.487693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30ae36-4af1-4169-947c-ffb033c6ff85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:17.488006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30ae36-4af1-4169-947c-ffb033c6ff85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:17.489377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30ae36-4af1-4169-947c-ffb033c6ff85 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:17.502130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 291/580] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:17.503006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30ae36-4af1-4169-947c-ffb033c6ff85 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.513745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:17.569260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34c820-9826-4b59-828d-68b0b7f0ca9c None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.579168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:17.604569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91b61d-ba5b-4623-b658-49efc7091516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.605234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91b61d-ba5b-4623-b658-49efc7091516 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.605521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91b61d-ba5b-4623-b658-49efc7091516 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.605801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91b61d-ba5b-4623-b658-49efc7091516 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.606564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91b61d-ba5b-4623-b658-49efc7091516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:17.606874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91b61d-ba5b-4623-b658-49efc7091516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:17.608243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91b61d-ba5b-4623-b658-49efc7091516 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:17.611557 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30ae36-4af1-4169-947c-ffb033c6ff85 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.620523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 290/581] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:17.621347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91b61d-ba5b-4623-b658-49efc7091516 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.649513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67ed39-56cd-4e15-a4ff-77a0cbe1fe29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.650181 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67ed39-56cd-4e15-a4ff-77a0cbe1fe29 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.650501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67ed39-56cd-4e15-a4ff-77a0cbe1fe29 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.650784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67ed39-56cd-4e15-a4ff-77a0cbe1fe29 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.651536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67ed39-56cd-4e15-a4ff-77a0cbe1fe29 None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:17.651845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67ed39-56cd-4e15-a4ff-77a0cbe1fe29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:17.653241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67ed39-56cd-4e15-a4ff-77a0cbe1fe29 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:17.661490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 292/582] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:17.662213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67ed39-56cd-4e15-a4ff-77a0cbe1fe29 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.729971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:17.738807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91b61d-ba5b-4623-b658-49efc7091516 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.768188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67ed39-56cd-4e15-a4ff-77a0cbe1fe29 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.775231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22a83e-0c87-429d-973f-1aea71c098c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.776136 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22a83e-0c87-429d-973f-1aea71c098c3 None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.776424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22a83e-0c87-429d-973f-1aea71c098c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.776705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22a83e-0c87-429d-973f-1aea71c098c3 None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/0d639e845cfa4f10b8e86cd237664c9b/roles/758fd66475334e07a52a5472784207a7` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.792702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22a83e-0c87-429d-973f-1aea71c098c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=0d639e845cfa4f10b8e86cd237664c9b, role_id=758fd66475334e07a52a5472784207a7)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:17.794155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22a83e-0c87-429d-973f-1aea71c098c3 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:17.804699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588adba-c8f6-4240-8d4b-c063dcc2fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:17.806246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588adba-c8f6-4240-8d4b-c063dcc2fa25 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:17.806643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588adba-c8f6-4240-8d4b-c063dcc2fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:17.806912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588adba-c8f6-4240-8d4b-c063dcc2fa25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:17.807940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588adba-c8f6-4240-8d4b-c063dcc2fa25 None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=cbf19adc48f0439b9cdcb1aaedd58a01) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:17.808250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588adba-c8f6-4240-8d4b-c063dcc2fa25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:17.809731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588adba-c8f6-4240-8d4b-c063dcc2fa25 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:17.811591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 291/583] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:37:17 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/0d639e845cfa4f10b8e86cd237664c9b/roles/758fd66475334e07a52a5472784207a7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:37:17.812726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22a83e-0c87-429d-973f-1aea71c098c3 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.817820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 293/584] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:17 2022] GET /identity/v3/role_assignments?user.id=cbf19adc48f0439b9cdcb1aaedd58a01&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:17.818274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588adba-c8f6-4240-8d4b-c063dcc2fa25 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:17.841768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:17.958308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22a83e-0c87-429d-973f-1aea71c098c3 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:17.980952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588adba-c8f6-4240-8d4b-c063dcc2fa25 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:18.010016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8c0e8-6b32-4364-95a8-8a70cb2450d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.010847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8c0e8-6b32-4364-95a8-8a70cb2450d1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.011129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8c0e8-6b32-4364-95a8-8a70cb2450d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.011410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8c0e8-6b32-4364-95a8-8a70cb2450d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.021945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8c0e8-6b32-4364-95a8-8a70cb2450d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.024053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8c0e8-6b32-4364-95a8-8a70cb2450d1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:18.029120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:18.040728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5579be-48c1-48a8-9ec2-0d78c3fc3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-76e8c0e8-6b32-4364-95a8-8a70cb2450d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:18.041407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:18.042341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:37:18.043356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:18.043909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5579be-48c1-48a8-9ec2-0d78c3fc3d81 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.043909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5579be-48c1-48a8-9ec2-0d78c3fc3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.043909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5579be-48c1-48a8-9ec2-0d78c3fc3d81 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.044100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 292/585] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:18.044100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8c0e8-6b32-4364-95a8-8a70cb2450d1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:18.055662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5579be-48c1-48a8-9ec2-0d78c3fc3d81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.058297 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5579be-48c1-48a8-9ec2-0d78c3fc3d81 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-1d5579be-48c1-48a8-9ec2-0d78c3fc3d81 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:18.078880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:18.079896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:37:18.080841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:18.084155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 294/586] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:18.085277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5579be-48c1-48a8-9ec2-0d78c3fc3d81 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:18.165737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:18.197603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8c0e8-6b32-4364-95a8-8a70cb2450d1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:18.202344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5579be-48c1-48a8-9ec2-0d78c3fc3d81 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:18.244234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765992d-335f-4086-a51d-63d4ed1bb6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.244985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765992d-335f-4086-a51d-63d4ed1bb6ac None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.245103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa581c-0d24-4977-8ffb-7417025d4b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.245476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765992d-335f-4086-a51d-63d4ed1bb6ac None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.245859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765992d-335f-4086-a51d-63d4ed1bb6ac None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.246368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa581c-0d24-4977-8ffb-7417025d4b27 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.246791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa581c-0d24-4977-8ffb-7417025d4b27 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.247039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765992d-335f-4086-a51d-63d4ed1bb6ac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:18.247369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa581c-0d24-4977-8ffb-7417025d4b27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.247518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765992d-335f-4086-a51d-63d4ed1bb6ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.249357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765992d-335f-4086-a51d-63d4ed1bb6ac None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:18.261648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa581c-0d24-4977-8ffb-7417025d4b27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.263551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa581c-0d24-4977-8ffb-7417025d4b27 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:18.274455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 295/587] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 23 10:37:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:18.274455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765992d-335f-4086-a51d-63d4ed1bb6ac None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-74aa581c-0d24-4977-8ffb-7417025d4b27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:18.293955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:18.294956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:18.295851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:18.295851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:18.295851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:18.295851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:18.296495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 293/588] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:18.297060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa581c-0d24-4977-8ffb-7417025d4b27 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:18.348708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:18.413210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765992d-335f-4086-a51d-63d4ed1bb6ac None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:18.428819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa581c-0d24-4977-8ffb-7417025d4b27 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:18.464915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:18.471735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34440e2-4f01-4222-8f37-e8ca6e6d5fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.472295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daf461-8763-40d6-8ea3-7e4c45ddbf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.473097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daf461-8763-40d6-8ea3-7e4c45ddbf7d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.473385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daf461-8763-40d6-8ea3-7e4c45ddbf7d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.473662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92daf461-8763-40d6-8ea3-7e4c45ddbf7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.474276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34440e2-4f01-4222-8f37-e8ca6e6d5fcd None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.475047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34440e2-4f01-4222-8f37-e8ca6e6d5fcd None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.475668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34440e2-4f01-4222-8f37-e8ca6e6d5fcd None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.477818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34440e2-4f01-4222-8f37-e8ca6e6d5fcd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:18.478538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34440e2-4f01-4222-8f37-e8ca6e6d5fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.480468 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34440e2-4f01-4222-8f37-e8ca6e6d5fcd None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:18.495373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92daf461-8763-40d6-8ea3-7e4c45ddbf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.496755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92daf461-8763-40d6-8ea3-7e4c45ddbf7d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:18.504123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 296/589] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 23 10:37:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:18.505816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34440e2-4f01-4222-8f37-e8ca6e6d5fcd None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-92daf461-8763-40d6-8ea3-7e4c45ddbf7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:18.524046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:18.525107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:18.526009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:18.526009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:18.526009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:18.526009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:18.530153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 294/590] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:18.531555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daf461-8763-40d6-8ea3-7e4c45ddbf7d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:18.652707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34440e2-4f01-4222-8f37-e8ca6e6d5fcd None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:18.670606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:18.681850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92daf461-8763-40d6-8ea3-7e4c45ddbf7d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:18.717049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e7728-ba90-4cab-9f9f-e6b1acc93829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.718212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e7728-ba90-4cab-9f9f-e6b1acc93829 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.718864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e7728-ba90-4cab-9f9f-e6b1acc93829 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.719349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e7728-ba90-4cab-9f9f-e6b1acc93829 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.720862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e7728-ba90-4cab-9f9f-e6b1acc93829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:18.721174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e7728-ba90-4cab-9f9f-e6b1acc93829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.723701 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e7728-ba90-4cab-9f9f-e6b1acc93829 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:18.726408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93184072-3ac4-4a88-a78a-c96ba9516775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.728057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93184072-3ac4-4a88-a78a-c96ba9516775 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.729122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93184072-3ac4-4a88-a78a-c96ba9516775 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.729640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93184072-3ac4-4a88-a78a-c96ba9516775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.740142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 297/591] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:18.740781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e7728-ba90-4cab-9f9f-e6b1acc93829 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:18.743254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93184072-3ac4-4a88-a78a-c96ba9516775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.746530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93184072-3ac4-4a88-a78a-c96ba9516775 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-93184072-3ac4-4a88-a78a-c96ba9516775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:18.770291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:18.771278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:18.772168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:18.772168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:18.772168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:18.772168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:18.774138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 295/592] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:18.775306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93184072-3ac4-4a88-a78a-c96ba9516775 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:18.825068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:18.859231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e7728-ba90-4cab-9f9f-e6b1acc93829 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:18.894725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a277f85-a26a-4ae3-9b4b-8491c1d3f984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.895450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a277f85-a26a-4ae3-9b4b-8491c1d3f984 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.895738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a277f85-a26a-4ae3-9b4b-8491c1d3f984 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.896017 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a277f85-a26a-4ae3-9b4b-8491c1d3f984 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.896797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a277f85-a26a-4ae3-9b4b-8491c1d3f984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:18.897106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a277f85-a26a-4ae3-9b4b-8491c1d3f984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.899082 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a277f85-a26a-4ae3-9b4b-8491c1d3f984 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:18.917046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 298/593] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:18.917937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a277f85-a26a-4ae3-9b4b-8491c1d3f984 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:18.919391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93184072-3ac4-4a88-a78a-c96ba9516775 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:18.956412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:18.956631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f65ab-a3a3-421d-8a3d-18722ee12d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:18.958557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f65ab-a3a3-421d-8a3d-18722ee12d41 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:18.958557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f65ab-a3a3-421d-8a3d-18722ee12d41 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:18.958835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f65ab-a3a3-421d-8a3d-18722ee12d41 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:18.967787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f65ab-a3a3-421d-8a3d-18722ee12d41 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:18.969432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f65ab-a3a3-421d-8a3d-18722ee12d41 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-c05f65ab-a3a3-421d-8a3d-18722ee12d41 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:19.014433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:19.015953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:37:19.017704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:19.022649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 296/594] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:19.025036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f65ab-a3a3-421d-8a3d-18722ee12d41 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:19.086621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a277f85-a26a-4ae3-9b4b-8491c1d3f984 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:19.154901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc837f-106c-4352-bab5-324320607148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:19.156519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc837f-106c-4352-bab5-324320607148 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:19.156977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc837f-106c-4352-bab5-324320607148 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:19.157436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc837f-106c-4352-bab5-324320607148 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:19.159186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc837f-106c-4352-bab5-324320607148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:19.159695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc837f-106c-4352-bab5-324320607148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:19.162911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc837f-106c-4352-bab5-324320607148 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.185755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:19.191374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 299/595] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:19.192972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc837f-106c-4352-bab5-324320607148 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:19.193472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f65ab-a3a3-421d-8a3d-18722ee12d41 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:19.235230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a022-65fb-40f9-9eb9-59ee30a8f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:19.236025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a022-65fb-40f9-9eb9-59ee30a8f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:19.236458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a022-65fb-40f9-9eb9-59ee30a8f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:19.236759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a022-65fb-40f9-9eb9-59ee30a8f4c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:19.250140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a022-65fb-40f9-9eb9-59ee30a8f4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:19.251972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a022-65fb-40f9-9eb9-59ee30a8f4c5 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-d396a022-65fb-40f9-9eb9-59ee30a8f4c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:19.271582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:19.272538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:19.273620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:19.273620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:19.273620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:19.273620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:19.273620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:19.273620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:19.273620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:19.273620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:19.277853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 297/596] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:19.278743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a022-65fb-40f9-9eb9-59ee30a8f4c5 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:19.327105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:19.342894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc837f-106c-4352-bab5-324320607148 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:19.384290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a022-65fb-40f9-9eb9-59ee30a8f4c5 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:19.391380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db954f-0fff-41a5-95f9-ba7fe03c1a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:19.392675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db954f-0fff-41a5-95f9-ba7fe03c1a04 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:19.392967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db954f-0fff-41a5-95f9-ba7fe03c1a04 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:19.393255 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db954f-0fff-41a5-95f9-ba7fe03c1a04 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:19.394668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db954f-0fff-41a5-95f9-ba7fe03c1a04 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:19.394990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db954f-0fff-41a5-95f9-ba7fe03c1a04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:19.397149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db954f-0fff-41a5-95f9-ba7fe03c1a04 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.421164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74301-b707-42d1-a84a-9aa83217b3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:19.422056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74301-b707-42d1-a84a-9aa83217b3c7 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:19.422454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74301-b707-42d1-a84a-9aa83217b3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:19.422840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 300/597] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 23 10:37:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:19.424181 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db954f-0fff-41a5-95f9-ba7fe03c1a04 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:19.426585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d74301-b707-42d1-a84a-9aa83217b3c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:19.436589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74301-b707-42d1-a84a-9aa83217b3c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:19.438138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d74301-b707-42d1-a84a-9aa83217b3c7 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-a9d74301-b707-42d1-a84a-9aa83217b3c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:19.453405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:19.454496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:19.455412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:19.455412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:19.455412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:19.455412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:19.455412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:19.455412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:19.455412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:19.455412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:19.458825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 298/598] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:19.459748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74301-b707-42d1-a84a-9aa83217b3c7 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:19.488189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:19.560580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db954f-0fff-41a5-95f9-ba7fe03c1a04 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:19.586657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d74301-b707-42d1-a84a-9aa83217b3c7 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:19.607651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b70b1-e41e-423e-a10f-96c0619b9119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:19.608440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b70b1-e41e-423e-a10f-96c0619b9119 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:19.608731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b70b1-e41e-423e-a10f-96c0619b9119 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:19.609018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b70b1-e41e-423e-a10f-96c0619b9119 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:19.609850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b70b1-e41e-423e-a10f-96c0619b9119 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:19.610170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b70b1-e41e-423e-a10f-96c0619b9119 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:19.611725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b70b1-e41e-423e-a10f-96c0619b9119 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.628714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e1fc6-47a1-44bf-8d1b-5eedcc927e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:19.634727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 301/599] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:19.634727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b70b1-e41e-423e-a10f-96c0619b9119 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:19.635750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e1fc6-47a1-44bf-8d1b-5eedcc927e61 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:19.636268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e1fc6-47a1-44bf-8d1b-5eedcc927e61 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:19.636774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e1fc6-47a1-44bf-8d1b-5eedcc927e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:19.641439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:19.651499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e1fc6-47a1-44bf-8d1b-5eedcc927e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:19.653453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e1fc6-47a1-44bf-8d1b-5eedcc927e61 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-874e1fc6-47a1-44bf-8d1b-5eedcc927e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:19.673421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:19.674421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:19.675316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:19.675316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:19.675316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:19.675316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:19.682775 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 299/600] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:19.684484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e1fc6-47a1-44bf-8d1b-5eedcc927e61 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:19.741661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b70b1-e41e-423e-a10f-96c0619b9119 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:19.760637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:19.779231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaa5b1-977c-4632-a1db-bcd4241ab8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:19.780060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaa5b1-977c-4632-a1db-bcd4241ab8f0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:19.780349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaa5b1-977c-4632-a1db-bcd4241ab8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:19.780632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eaa5b1-977c-4632-a1db-bcd4241ab8f0 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:19.781436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eaa5b1-977c-4632-a1db-bcd4241ab8f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:19.781752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eaa5b1-977c-4632-a1db-bcd4241ab8f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:19.783298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eaa5b1-977c-4632-a1db-bcd4241ab8f0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.800799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 302/601] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:19.800799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaa5b1-977c-4632-a1db-bcd4241ab8f0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:19.808415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e1fc6-47a1-44bf-8d1b-5eedcc927e61 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:19.846756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0039d8b-a646-4712-a6cc-7916bcaab629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:19.848084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0039d8b-a646-4712-a6cc-7916bcaab629 None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:19.848562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0039d8b-a646-4712-a6cc-7916bcaab629 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:19.849054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0039d8b-a646-4712-a6cc-7916bcaab629 None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/0930d783a2574d5caeb2587fe4157cf8/roles/758fd66475334e07a52a5472784207a7` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:19.866206 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0039d8b-a646-4712-a6cc-7916bcaab629 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=0930d783a2574d5caeb2587fe4157cf8, role_id=758fd66475334e07a52a5472784207a7)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:19.868159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0039d8b-a646-4712-a6cc-7916bcaab629 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.869379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:19.890504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 300/602] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:37:19 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/0930d783a2574d5caeb2587fe4157cf8/roles/758fd66475334e07a52a5472784207a7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:37:19.891885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0039d8b-a646-4712-a6cc-7916bcaab629 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:19.909374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eaa5b1-977c-4632-a1db-bcd4241ab8f0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:19.949631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08e39c-239e-4701-a46f-d6beb2b15379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:19.950389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08e39c-239e-4701-a46f-d6beb2b15379 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:19.950646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08e39c-239e-4701-a46f-d6beb2b15379 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:19.951234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08e39c-239e-4701-a46f-d6beb2b15379 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:19.952239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08e39c-239e-4701-a46f-d6beb2b15379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:19.952698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08e39c-239e-4701-a46f-d6beb2b15379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:19.954199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08e39c-239e-4701-a46f-d6beb2b15379 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:19.968232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 303/603] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:19.983547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08e39c-239e-4701-a46f-d6beb2b15379 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:20.049595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0039d8b-a646-4712-a6cc-7916bcaab629 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:20.069843 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:20.093563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d947bf-bc9e-4097-919c-941c806a09dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:20.094624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d947bf-bc9e-4097-919c-941c806a09dc None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.094964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d947bf-bc9e-4097-919c-941c806a09dc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.095249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d947bf-bc9e-4097-919c-941c806a09dc None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/33a1696d1cc14ca6ac1cb970598f11fa/roles/758fd66475334e07a52a5472784207a7` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.112874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08e39c-239e-4701-a46f-d6beb2b15379 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:20.114055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d947bf-bc9e-4097-919c-941c806a09dc None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=33a1696d1cc14ca6ac1cb970598f11fa, role_id=758fd66475334e07a52a5472784207a7)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:20.115739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d947bf-bc9e-4097-919c-941c806a09dc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:20.139510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 301/604] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:37:19 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/33a1696d1cc14ca6ac1cb970598f11fa/roles/758fd66475334e07a52a5472784207a7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:37:20.141226 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e5c0-7495-4bdd-888e-7b990979ab94 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.141521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e5c0-7495-4bdd-888e-7b990979ab94 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.141827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e5c0-7495-4bdd-888e-7b990979ab94 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.143537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 302/605] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:20.144788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3ad2e-7d0f-44d5-ac15-1da6e84b8482 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.145077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3ad2e-7d0f-44d5-ac15-1da6e84b8482 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.145363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3ad2e-7d0f-44d5-ac15-1da6e84b8482 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.146674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:20.151599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 303/606] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:20.152992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003273d-49f6-4fa6-92de-95c3ae9c5bad None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.153284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003273d-49f6-4fa6-92de-95c3ae9c5bad None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.153582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003273d-49f6-4fa6-92de-95c3ae9c5bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.157718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c471d84-8032-4d3b-8e59-2f45d1b295a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:20.158645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c471d84-8032-4d3b-8e59-2f45d1b295a7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.158927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c471d84-8032-4d3b-8e59-2f45d1b295a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.159202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c471d84-8032-4d3b-8e59-2f45d1b295a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.168699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c471d84-8032-4d3b-8e59-2f45d1b295a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:20.170189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c471d84-8032-4d3b-8e59-2f45d1b295a7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:20.171962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0003273d-49f6-4fa6-92de-95c3ae9c5bad None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:20.173241 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0003273d-49f6-4fa6-92de-95c3ae9c5bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-9c471d84-8032-4d3b-8e59-2f45d1b295a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:20.194794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:20.196037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:20.197342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:20.197342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:20.197342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:20.197342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:20.197342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:20.197342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:20.197342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:20.197342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:20.197342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 304/607] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:20.202782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c68480-2faf-4d0f-9b5a-1f0c9985ce93 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.203192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c68480-2faf-4d0f-9b5a-1f0c9985ce93 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.203489 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c68480-2faf-4d0f-9b5a-1f0c9985ce93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.222894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-44c68480-2faf-4d0f-9b5a-1f0c9985ce93 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:20.224226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-44c68480-2faf-4d0f-9b5a-1f0c9985ce93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:20.264319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 304/608] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:20.265277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003273d-49f6-4fa6-92de-95c3ae9c5bad None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:20.329133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 305/609] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:20.329909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c68480-2faf-4d0f-9b5a-1f0c9985ce93 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:20.387920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:20.398769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003273d-49f6-4fa6-92de-95c3ae9c5bad None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:20.437434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35667d-8d33-4a20-a9ad-8e84126d142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:20.438431 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35667d-8d33-4a20-a9ad-8e84126d142a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.438803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35667d-8d33-4a20-a9ad-8e84126d142a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.439085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35667d-8d33-4a20-a9ad-8e84126d142a None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.440202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35667d-8d33-4a20-a9ad-8e84126d142a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:20.440514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35667d-8d33-4a20-a9ad-8e84126d142a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:20.442608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35667d-8d33-4a20-a9ad-8e84126d142a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:20.456079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c68480-2faf-4d0f-9b5a-1f0c9985ce93 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:20.457938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 305/610] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:20.459715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35667d-8d33-4a20-a9ad-8e84126d142a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:20.476763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:20.501606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092a862-4352-4d73-ad7c-1a951849820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:20.502561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092a862-4352-4d73-ad7c-1a951849820d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.502942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092a862-4352-4d73-ad7c-1a951849820d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.503279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092a862-4352-4d73-ad7c-1a951849820d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.515510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092a862-4352-4d73-ad7c-1a951849820d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-d092a862-4352-4d73-ad7c-1a951849820d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:20.524026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:20.525183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:20.526361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:20.530484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 306/611] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:20.531437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092a862-4352-4d73-ad7c-1a951849820d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:20.583060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35667d-8d33-4a20-a9ad-8e84126d142a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:20.618976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa861c-c580-4f7e-bb8c-60e2845d875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:20.620065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa861c-c580-4f7e-bb8c-60e2845d875f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.620320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa861c-c580-4f7e-bb8c-60e2845d875f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.620687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa861c-c580-4f7e-bb8c-60e2845d875f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.631857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa861c-c580-4f7e-bb8c-60e2845d875f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-e9fa861c-c580-4f7e-bb8c-60e2845d875f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:20.641056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:20.642010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:20.642889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:20.646539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092a862-4352-4d73-ad7c-1a951849820d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:20.646847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 306/612] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:20.647767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa861c-c580-4f7e-bb8c-60e2845d875f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:20.677694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:20.692772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cc19f-5f02-424c-a9f7-8eb1c989c7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:20.693989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cc19f-5f02-424c-a9f7-8eb1c989c7e5 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.694285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cc19f-5f02-424c-a9f7-8eb1c989c7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.694601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cc19f-5f02-424c-a9f7-8eb1c989c7e5 None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/ed8f21a950d6483abc7ab67fb533942a/roles/758fd66475334e07a52a5472784207a7` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.717101 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cc19f-5f02-424c-a9f7-8eb1c989c7e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=ed8f21a950d6483abc7ab67fb533942a, role_id=758fd66475334e07a52a5472784207a7)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:20.719202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cc19f-5f02-424c-a9f7-8eb1c989c7e5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:20.739350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 307/613] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:37:20 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/ed8f21a950d6483abc7ab67fb533942a/roles/758fd66475334e07a52a5472784207a7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:37:20.740582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cc19f-5f02-424c-a9f7-8eb1c989c7e5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:20.779969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:20.798870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa861c-c580-4f7e-bb8c-60e2845d875f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:20.839023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c59d5-7f3d-4cec-b1ee-fd43eddd5552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:20.840082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c59d5-7f3d-4cec-b1ee-fd43eddd5552 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.840624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c59d5-7f3d-4cec-b1ee-fd43eddd5552 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.841096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c59d5-7f3d-4cec-b1ee-fd43eddd5552 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.842106 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c59d5-7f3d-4cec-b1ee-fd43eddd5552 None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:20.842723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c59d5-7f3d-4cec-b1ee-fd43eddd5552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:20.844391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c59d5-7f3d-4cec-b1ee-fd43eddd5552 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:20.855838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 307/614] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:20.862397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c59d5-7f3d-4cec-b1ee-fd43eddd5552 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:20.885693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cc19f-5f02-424c-a9f7-8eb1c989c7e5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:20.931942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17eff6c-b5f9-48c7-a00a-807154e58869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:20.932644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eff6c-b5f9-48c7-a00a-807154e58869 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:20.932934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eff6c-b5f9-48c7-a00a-807154e58869 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:20.933224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17eff6c-b5f9-48c7-a00a-807154e58869 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:20.933987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17eff6c-b5f9-48c7-a00a-807154e58869 None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:20.934301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17eff6c-b5f9-48c7-a00a-807154e58869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:20.936036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17eff6c-b5f9-48c7-a00a-807154e58869 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:20.947032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 308/615] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:20.952994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17eff6c-b5f9-48c7-a00a-807154e58869 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:21.025942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:21.052850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c59d5-7f3d-4cec-b1ee-fd43eddd5552 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:21.079256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:21.096891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17eff6c-b5f9-48c7-a00a-807154e58869 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:21.111633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa8def-8181-4d6a-9706-c62393bb2293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:21.112798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8def-8181-4d6a-9706-c62393bb2293 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:21.113384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8def-8181-4d6a-9706-c62393bb2293 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:21.113908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa8def-8181-4d6a-9706-c62393bb2293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:21.141414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa8def-8181-4d6a-9706-c62393bb2293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:21.143815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa8def-8181-4d6a-9706-c62393bb2293 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:21.162843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9b92-9f06-4a3f-81e2-aac688a9a5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:21.164013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9b92-9f06-4a3f-81e2-aac688a9a5de None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:21.165471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9b92-9f06-4a3f-81e2-aac688a9a5de None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:21.166024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9b92-9f06-4a3f-81e2-aac688a9a5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-aaaa8def-8181-4d6a-9706-c62393bb2293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:21.183129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:21.184072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:21.184968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:21.184968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:21.184968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:21.184968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:21.191440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 308/616] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:21.192889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d9b92-9f06-4a3f-81e2-aac688a9a5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:21.195257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa8def-8181-4d6a-9706-c62393bb2293 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:21.196311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d9b92-9f06-4a3f-81e2-aac688a9a5de None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-5e9d9b92-9f06-4a3f-81e2-aac688a9a5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:21.232913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:21.233868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:21.234817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:21.234817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:21.234817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:21.234817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:21.237053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 309/617] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:21.247827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9b92-9f06-4a3f-81e2-aac688a9a5de None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:21.394402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa8def-8181-4d6a-9706-c62393bb2293 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:21.400163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d9b92-9f06-4a3f-81e2-aac688a9a5de None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:21.445860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc3b38-9c1e-4698-9571-e2bee51f681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:21.446815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc3b38-9c1e-4698-9571-e2bee51f681c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:21.447062 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc3b38-9c1e-4698-9571-e2bee51f681c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:21.447345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc3b38-9c1e-4698-9571-e2bee51f681c None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:21.448109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc3b38-9c1e-4698-9571-e2bee51f681c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:21.448421 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc3b38-9c1e-4698-9571-e2bee51f681c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:21.449867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc3b38-9c1e-4698-9571-e2bee51f681c None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:21.454529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:21.460270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:21.465948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 310/618] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:21.471106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc3b38-9c1e-4698-9571-e2bee51f681c None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:21.482250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04910154-49f8-48ab-adab-de044358d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:21.482952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04910154-49f8-48ab-adab-de044358d312 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:21.483229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04910154-49f8-48ab-adab-de044358d312 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:21.483515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04910154-49f8-48ab-adab-de044358d312 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:21.484251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04910154-49f8-48ab-adab-de044358d312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:21.484562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04910154-49f8-48ab-adab-de044358d312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:21.485942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04910154-49f8-48ab-adab-de044358d312 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:21.511869 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 309/619] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:21.519342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04910154-49f8-48ab-adab-de044358d312 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:21.596916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc3b38-9c1e-4698-9571-e2bee51f681c None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:21.655692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb079c-a608-41af-865a-9939b786c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:21.656427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb079c-a608-41af-865a-9939b786c353 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:21.656713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb079c-a608-41af-865a-9939b786c353 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:21.656995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb079c-a608-41af-865a-9939b786c353 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:21.678246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04910154-49f8-48ab-adab-de044358d312 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:21.680248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb079c-a608-41af-865a-9939b786c353 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:21.682147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb079c-a608-41af-865a-9939b786c353 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-f9eb079c-a608-41af-865a-9939b786c353 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:21.706965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:21.714621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:21.715594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:21.717304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 311/620] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 23 10:37:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:21.717412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f8286-7cb8-4900-84c6-5eec03be281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:21.718122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f8286-7cb8-4900-84c6-5eec03be281c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:21.722515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f8286-7cb8-4900-84c6-5eec03be281c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:21.722839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f8286-7cb8-4900-84c6-5eec03be281c None admin] PATH_INFO: `/v3/users/swift` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:21.731551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f8286-7cb8-4900-84c6-5eec03be281c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:21.732835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb079c-a608-41af-865a-9939b786c353 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:21.733034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f8286-7cb8-4900-84c6-5eec03be281c None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-dd7f8286-7cb8-4900-84c6-5eec03be281c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:21.749355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:21.751526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:21.753705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 310/621] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:21.758340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f8286-7cb8-4900-84c6-5eec03be281c None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:21.831553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:21.863338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:21.884170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f8286-7cb8-4900-84c6-5eec03be281c None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:21.923518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617289a-67f8-4472-a052-35cd6fb5275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:21.923518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617289a-67f8-4472-a052-35cd6fb5275c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:21.923518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617289a-67f8-4472-a052-35cd6fb5275c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:21.923518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617289a-67f8-4472-a052-35cd6fb5275c None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:21.924169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617289a-67f8-4472-a052-35cd6fb5275c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:21.924711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617289a-67f8-4472-a052-35cd6fb5275c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:21.926406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617289a-67f8-4472-a052-35cd6fb5275c None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:21.948232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 311/622] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 23 10:37:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:21.953503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617289a-67f8-4472-a052-35cd6fb5275c None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:21.968746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb079c-a608-41af-865a-9939b786c353 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:22.012463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f5966-b116-4824-93e6-749fa3a3a676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:22.013464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f5966-b116-4824-93e6-749fa3a3a676 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.013746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f5966-b116-4824-93e6-749fa3a3a676 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.014025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f5966-b116-4824-93e6-749fa3a3a676 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.014905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f5966-b116-4824-93e6-749fa3a3a676 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:22.015221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f5966-b116-4824-93e6-749fa3a3a676 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:22.016698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f5966-b116-4824-93e6-749fa3a3a676 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:22.037936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 312/623] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 23 10:37:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:22.044220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f5966-b116-4824-93e6-749fa3a3a676 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:22.161857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f5966-b116-4824-93e6-749fa3a3a676 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:22.187810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:22.208120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a4dae-07cb-44cc-b7d4-4f8b2f30e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:22.208788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a4dae-07cb-44cc-b7d4-4f8b2f30e71f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.209078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a4dae-07cb-44cc-b7d4-4f8b2f30e71f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.209362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a4dae-07cb-44cc-b7d4-4f8b2f30e71f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.291578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617289a-67f8-4472-a052-35cd6fb5275c None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:22.309372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:22.354760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a4dae-07cb-44cc-b7d4-4f8b2f30e71f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:22.356345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a4dae-07cb-44cc-b7d4-4f8b2f30e71f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:22.375976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27dca4-caea-40ba-91d2-c5a2dcadef7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:22.376870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27dca4-caea-40ba-91d2-c5a2dcadef7d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.377165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27dca4-caea-40ba-91d2-c5a2dcadef7d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.377634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27dca4-caea-40ba-91d2-c5a2dcadef7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.403236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27dca4-caea-40ba-91d2-c5a2dcadef7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:22.404718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27dca4-caea-40ba-91d2-c5a2dcadef7d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-bf27dca4-caea-40ba-91d2-c5a2dcadef7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:22.446969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:22.447917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:22.448819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:22.448819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:22.448819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:22.448819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:22.448819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 312/624] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:22.458216 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27dca4-caea-40ba-91d2-c5a2dcadef7d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:22.482381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 313/625] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:37:22.482381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9576103-75f7-4db0-a484-3f8392428b7b None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.482381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9576103-75f7-4db0-a484-3f8392428b7b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.482381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9576103-75f7-4db0-a484-3f8392428b7b None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.482381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 314/626] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:22.487882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfec8f-3516-45a1-b75e-b546cd520d5a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.488171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfec8f-3516-45a1-b75e-b546cd520d5a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.488454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfec8f-3516-45a1-b75e-b546cd520d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.508019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ffbfec8f-3516-45a1-b75e-b546cd520d5a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:22.509423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ffbfec8f-3516-45a1-b75e-b546cd520d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:22.524423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:22.593187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 315/627] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:37:22.594442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfec8f-3516-45a1-b75e-b546cd520d5a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:22.605011 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27dca4-caea-40ba-91d2-c5a2dcadef7d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:22.642793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20a299-9a30-40a5-a7fc-d8f5dfd986f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:22.643450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20a299-9a30-40a5-a7fc-d8f5dfd986f4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.643743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20a299-9a30-40a5-a7fc-d8f5dfd986f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.644026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20a299-9a30-40a5-a7fc-d8f5dfd986f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.644757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20a299-9a30-40a5-a7fc-d8f5dfd986f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:22.645079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20a299-9a30-40a5-a7fc-d8f5dfd986f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:22.646481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20a299-9a30-40a5-a7fc-d8f5dfd986f4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:22.659644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 313/628] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:22.666109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1e85f-7411-487f-809c-16fbe4c66439 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.666427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1e85f-7411-487f-809c-16fbe4c66439 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.666710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1e85f-7411-487f-809c-16fbe4c66439 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.670362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 314/629] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:22.670362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1e85f-7411-487f-809c-16fbe4c66439 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:22.692406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:22.713768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfec8f-3516-45a1-b75e-b546cd520d5a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:22.752313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7779cfa-f7c5-41d5-9fe2-b06599e2d08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:22.753230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7779cfa-f7c5-41d5-9fe2-b06599e2d08f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.753519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7779cfa-f7c5-41d5-9fe2-b06599e2d08f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.753799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7779cfa-f7c5-41d5-9fe2-b06599e2d08f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.767490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7779cfa-f7c5-41d5-9fe2-b06599e2d08f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:22.769740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7779cfa-f7c5-41d5-9fe2-b06599e2d08f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:22.779089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1e85f-7411-487f-809c-16fbe4c66439 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:22.781953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-a7779cfa-f7c5-41d5-9fe2-b06599e2d08f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:22.793222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:22.794176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:22.795126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:22.795126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:22.795126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:22.795126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:22.795126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 316/630] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:22.795418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7779cfa-f7c5-41d5-9fe2-b06599e2d08f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:22.818547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbe017-2abd-43dc-9237-ee6ce05b60f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:22.819338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe017-2abd-43dc-9237-ee6ce05b60f0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.819626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe017-2abd-43dc-9237-ee6ce05b60f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.819907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe017-2abd-43dc-9237-ee6ce05b60f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.831516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbe017-2abd-43dc-9237-ee6ce05b60f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-1bdbe017-2abd-43dc-9237-ee6ce05b60f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:22.840242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:22.846648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 315/631] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:22.847700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113e2f2-30c8-4b42-b84a-7cb9ecf8c090 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.848536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113e2f2-30c8-4b42-b84a-7cb9ecf8c090 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.848536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113e2f2-30c8-4b42-b84a-7cb9ecf8c090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.865323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8113e2f2-30c8-4b42-b84a-7cb9ecf8c090 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:22.866572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8113e2f2-30c8-4b42-b84a-7cb9ecf8c090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:22.917847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7779cfa-f7c5-41d5-9fe2-b06599e2d08f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:22.937423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 316/632] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:22.938530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113e2f2-30c8-4b42-b84a-7cb9ecf8c090 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:22.959254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:22.964930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5038ec5-d33e-4f56-b493-11c8c7af11c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:22.965816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5038ec5-d33e-4f56-b493-11c8c7af11c5 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:22.966186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5038ec5-d33e-4f56-b493-11c8c7af11c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:22.966605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5038ec5-d33e-4f56-b493-11c8c7af11c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:22.974263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5038ec5-d33e-4f56-b493-11c8c7af11c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:22.976054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5038ec5-d33e-4f56-b493-11c8c7af11c5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-f5038ec5-d33e-4f56-b493-11c8c7af11c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:22.990863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:22.991949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:22.992956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:22.992956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:22.992956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:22.992956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:22.992956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:22.992956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:22.992956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:22.992956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:22.996934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 317/633] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:22.997670 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5038ec5-d33e-4f56-b493-11c8c7af11c5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.059062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113e2f2-30c8-4b42-b84a-7cb9ecf8c090 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.060826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:23.096568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff3fb-567f-423e-ade0-bb64d0fef965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.097235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff3fb-567f-423e-ade0-bb64d0fef965 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.097519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff3fb-567f-423e-ade0-bb64d0fef965 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.097799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bff3fb-567f-423e-ade0-bb64d0fef965 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.098616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff3fb-567f-423e-ade0-bb64d0fef965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:23.098924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff3fb-567f-423e-ade0-bb64d0fef965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.100575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bff3fb-567f-423e-ade0-bb64d0fef965 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:23.108279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5038ec5-d33e-4f56-b493-11c8c7af11c5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.114679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 317/634] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:23.115405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff3fb-567f-423e-ade0-bb64d0fef965 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.148584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048cd9d-c5ce-4dc1-95f3-799ec30da473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.149250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048cd9d-c5ce-4dc1-95f3-799ec30da473 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.149532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048cd9d-c5ce-4dc1-95f3-799ec30da473 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.149818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048cd9d-c5ce-4dc1-95f3-799ec30da473 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.150569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048cd9d-c5ce-4dc1-95f3-799ec30da473 None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:23.150876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048cd9d-c5ce-4dc1-95f3-799ec30da473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.152242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048cd9d-c5ce-4dc1-95f3-799ec30da473 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:23.165356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 318/635] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:23.165356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048cd9d-c5ce-4dc1-95f3-799ec30da473 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.194983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:23.229324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bff3fb-567f-423e-ade0-bb64d0fef965 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.261588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c9baa-dc2d-4f69-803e-9af6a380ed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.262406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c9baa-dc2d-4f69-803e-9af6a380ed47 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.262694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c9baa-dc2d-4f69-803e-9af6a380ed47 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.262970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c9baa-dc2d-4f69-803e-9af6a380ed47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.264750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048cd9d-c5ce-4dc1-95f3-799ec30da473 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.272962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c9baa-dc2d-4f69-803e-9af6a380ed47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-8f2c9baa-dc2d-4f69-803e-9af6a380ed47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:23.281059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:23.282234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 318/636] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:23.283314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c9baa-dc2d-4f69-803e-9af6a380ed47 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.293174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:23.306718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be840544-94ae-4b09-90ad-2bd8ca79cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.307119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be840544-94ae-4b09-90ad-2bd8ca79cbb9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.307408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be840544-94ae-4b09-90ad-2bd8ca79cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.307687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be840544-94ae-4b09-90ad-2bd8ca79cbb9 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.308472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be840544-94ae-4b09-90ad-2bd8ca79cbb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:23.308780 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be840544-94ae-4b09-90ad-2bd8ca79cbb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.310210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be840544-94ae-4b09-90ad-2bd8ca79cbb9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:23.322881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 319/637] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:23.323684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be840544-94ae-4b09-90ad-2bd8ca79cbb9 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.392506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c9baa-dc2d-4f69-803e-9af6a380ed47 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.422495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:23.428853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee379e24-dead-4760-94ad-2836fcc6ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.429712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee379e24-dead-4760-94ad-2836fcc6ba04 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.429997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee379e24-dead-4760-94ad-2836fcc6ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.430129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be840544-94ae-4b09-90ad-2bd8ca79cbb9 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.430422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee379e24-dead-4760-94ad-2836fcc6ba04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.436936 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee379e24-dead-4760-94ad-2836fcc6ba04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.438419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee379e24-dead-4760-94ad-2836fcc6ba04 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-ee379e24-dead-4760-94ad-2836fcc6ba04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:23.453130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:23.454375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:23.455306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:23.455306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:23.455306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:23.455306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:23.455306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:23.455306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:23.455306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:23.455306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:23.455306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 319/638] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:23.455810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0f3b5-7043-462c-886c-30d397d50c7f None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.455953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0f3b5-7043-462c-886c-30d397d50c7f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.456237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0f3b5-7043-462c-886c-30d397d50c7f None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.457613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 320/639] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:23.459082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0f3b5-7043-462c-886c-30d397d50c7f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.469150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697968ed-8fb9-4e81-bec7-132060d0fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.469938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697968ed-8fb9-4e81-bec7-132060d0fe1e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.470217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697968ed-8fb9-4e81-bec7-132060d0fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.470531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697968ed-8fb9-4e81-bec7-132060d0fe1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.481448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697968ed-8fb9-4e81-bec7-132060d0fe1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.482958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697968ed-8fb9-4e81-bec7-132060d0fe1e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-697968ed-8fb9-4e81-bec7-132060d0fe1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:23.500751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:23.501896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:23.502888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:23.502888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:23.502888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:23.502888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:23.502888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 320/640] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:23.502888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697968ed-8fb9-4e81-bec7-132060d0fe1e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.541382 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:23.566611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0f3b5-7043-462c-886c-30d397d50c7f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.601134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07aa5f-aee4-422a-afd8-4f99aba6e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.601893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07aa5f-aee4-422a-afd8-4f99aba6e80e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.602184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07aa5f-aee4-422a-afd8-4f99aba6e80e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.602708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07aa5f-aee4-422a-afd8-4f99aba6e80e None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.603499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07aa5f-aee4-422a-afd8-4f99aba6e80e None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:23.603815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07aa5f-aee4-422a-afd8-4f99aba6e80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.605247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07aa5f-aee4-422a-afd8-4f99aba6e80e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:23.610106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697968ed-8fb9-4e81-bec7-132060d0fe1e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.614070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 321/641] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:23.614955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07aa5f-aee4-422a-afd8-4f99aba6e80e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.645856 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ea1e3-6de3-4e6b-91e2-730e9f3c8c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.646774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea1e3-6de3-4e6b-91e2-730e9f3c8c63 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.647062 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea1e3-6de3-4e6b-91e2-730e9f3c8c63 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.647350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ea1e3-6de3-4e6b-91e2-730e9f3c8c63 None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/cbf19adc48f0439b9cdcb1aaedd58a01/roles/758fd66475334e07a52a5472784207a7` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.663671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ea1e3-6de3-4e6b-91e2-730e9f3c8c63 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=cbf19adc48f0439b9cdcb1aaedd58a01, role_id=758fd66475334e07a52a5472784207a7)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.665145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ea1e3-6de3-4e6b-91e2-730e9f3c8c63 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:23.669801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:23.677664 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 321/642] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:37:23 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/cbf19adc48f0439b9cdcb1aaedd58a01/roles/758fd66475334e07a52a5472784207a7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:37:23.678932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082c7e-d934-4839-b7ef-9d57e071ccd3 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.679224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082c7e-d934-4839-b7ef-9d57e071ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.679571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62082c7e-d934-4839-b7ef-9d57e071ccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.698588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-62082c7e-d934-4839-b7ef-9d57e071ccd3 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:23.699830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-62082c7e-d934-4839-b7ef-9d57e071ccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:23.743639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07aa5f-aee4-422a-afd8-4f99aba6e80e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.786533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 322/643] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:23.787406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082c7e-d934-4839-b7ef-9d57e071ccd3 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.800753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823a966-e35c-4be6-918a-8f876b5e7c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.801444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823a966-e35c-4be6-918a-8f876b5e7c91 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.801743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823a966-e35c-4be6-918a-8f876b5e7c91 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.802026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823a966-e35c-4be6-918a-8f876b5e7c91 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.802872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823a966-e35c-4be6-918a-8f876b5e7c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:23.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823a966-e35c-4be6-918a-8f876b5e7c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.805984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823a966-e35c-4be6-918a-8f876b5e7c91 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:23.817466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:23.821832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 322/644] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:23.823122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823a966-e35c-4be6-918a-8f876b5e7c91 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.926768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62082c7e-d934-4839-b7ef-9d57e071ccd3 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.941276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823a966-e35c-4be6-918a-8f876b5e7c91 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:23.956825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:23.971156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a574cc-9f44-4a71-aabb-94789e78e63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.971821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a574cc-9f44-4a71-aabb-94789e78e63f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.972109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a574cc-9f44-4a71-aabb-94789e78e63f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.972390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a574cc-9f44-4a71-aabb-94789e78e63f None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.973245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a574cc-9f44-4a71-aabb-94789e78e63f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:23.973677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a574cc-9f44-4a71-aabb-94789e78e63f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.975106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a574cc-9f44-4a71-aabb-94789e78e63f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:23.978591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b9cfc-8480-4495-a26c-a3862cb61b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:23.979380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b9cfc-8480-4495-a26c-a3862cb61b7d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:23.979660 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b9cfc-8480-4495-a26c-a3862cb61b7d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:23.979934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b9cfc-8480-4495-a26c-a3862cb61b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:23.990681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 323/645] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:23.990854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b9cfc-8480-4495-a26c-a3862cb61b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:23.992563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a574cc-9f44-4a71-aabb-94789e78e63f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:23.992696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b9cfc-8480-4495-a26c-a3862cb61b7d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-ce2b9cfc-8480-4495-a26c-a3862cb61b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:24.013281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:24.014409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:24.015499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:24.015499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:24.015499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:24.015499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:24.015499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 323/646] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:24.015499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b9cfc-8480-4495-a26c-a3862cb61b7d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:24.082138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:24.111211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a574cc-9f44-4a71-aabb-94789e78e63f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.139639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b9cfc-8480-4495-a26c-a3862cb61b7d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.151655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a7d9a-f6d2-47cd-b83e-428de0a3fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:24.152460 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a7d9a-f6d2-47cd-b83e-428de0a3fa8a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:24.152746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a7d9a-f6d2-47cd-b83e-428de0a3fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:24.153017 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a7d9a-f6d2-47cd-b83e-428de0a3fa8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:24.164708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a7d9a-f6d2-47cd-b83e-428de0a3fa8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-8b5a7d9a-f6d2-47cd-b83e-428de0a3fa8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:24.172721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:24.173875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 324/647] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:24.175032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a7d9a-f6d2-47cd-b83e-428de0a3fa8a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:24.191545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072551e-28c7-4a14-aa6f-3c9240ce26dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:24.192639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072551e-28c7-4a14-aa6f-3c9240ce26dc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:24.193129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072551e-28c7-4a14-aa6f-3c9240ce26dc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:24.193592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072551e-28c7-4a14-aa6f-3c9240ce26dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:24.194733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072551e-28c7-4a14-aa6f-3c9240ce26dc None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=0d639e845cfa4f10b8e86cd237664c9b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:24.195373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072551e-28c7-4a14-aa6f-3c9240ce26dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:24.196995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072551e-28c7-4a14-aa6f-3c9240ce26dc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:24.214352 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 324/648] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:24 2022] GET /identity/v3/role_assignments?user.id=0d639e845cfa4f10b8e86cd237664c9b&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:24.214352 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072551e-28c7-4a14-aa6f-3c9240ce26dc None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:24.250262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:24.311631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a7d9a-f6d2-47cd-b83e-428de0a3fa8a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.354298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564897c-3157-4f8e-a430-3347b2b7437c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:24.355248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564897c-3157-4f8e-a430-3347b2b7437c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:24.355594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564897c-3157-4f8e-a430-3347b2b7437c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:24.355959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564897c-3157-4f8e-a430-3347b2b7437c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:24.357411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072551e-28c7-4a14-aa6f-3c9240ce26dc None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.358583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:24.367254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564897c-3157-4f8e-a430-3347b2b7437c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:24.370124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564897c-3157-4f8e-a430-3347b2b7437c None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-6564897c-3157-4f8e-a430-3347b2b7437c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:24.389324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:24.390565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:24.391734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 325/649] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:24.392398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564897c-3157-4f8e-a430-3347b2b7437c None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:24.408914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9a4b-fd83-4e8e-8209-6a17d524c391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:24.410139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9a4b-fd83-4e8e-8209-6a17d524c391 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:24.410632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9a4b-fd83-4e8e-8209-6a17d524c391 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:24.411079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb9a4b-fd83-4e8e-8209-6a17d524c391 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:24.412156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb9a4b-fd83-4e8e-8209-6a17d524c391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:24.413001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb9a4b-fd83-4e8e-8209-6a17d524c391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:24.414948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb9a4b-fd83-4e8e-8209-6a17d524c391 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:24.429821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 325/650] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:24.430966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9a4b-fd83-4e8e-8209-6a17d524c391 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:24.525322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564897c-3157-4f8e-a430-3347b2b7437c None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.562817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01021147-a0e5-4a60-9461-02c88d433081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:24.563420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021147-a0e5-4a60-9461-02c88d433081 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:24.563687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021147-a0e5-4a60-9461-02c88d433081 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:24.563966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021147-a0e5-4a60-9461-02c88d433081 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:24.564735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01021147-a0e5-4a60-9461-02c88d433081 None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:24.565302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01021147-a0e5-4a60-9461-02c88d433081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:24.566719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01021147-a0e5-4a60-9461-02c88d433081 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:24.574122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb9a4b-fd83-4e8e-8209-6a17d524c391 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.582256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 326/651] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:24.582533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:24.583420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01021147-a0e5-4a60-9461-02c88d433081 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:24.612182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcd79e-31c0-4239-be47-39fd8f815013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:24.613119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcd79e-31c0-4239-be47-39fd8f815013 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:24.613508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcd79e-31c0-4239-be47-39fd8f815013 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:24.613889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcd79e-31c0-4239-be47-39fd8f815013 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:24.614893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcd79e-31c0-4239-be47-39fd8f815013 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:24.615304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcd79e-31c0-4239-be47-39fd8f815013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:24.616849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcd79e-31c0-4239-be47-39fd8f815013 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:24.637421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 326/652] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 23 10:37:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:24.638499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcd79e-31c0-4239-be47-39fd8f815013 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:24.681816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:24.733624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01021147-a0e5-4a60-9461-02c88d433081 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.765487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcd79e-31c0-4239-be47-39fd8f815013 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.774868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ee6fd-858c-4d6f-bdfc-f3b6e67a3443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:24.775689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee6fd-858c-4d6f-bdfc-f3b6e67a3443 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:24.775976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee6fd-858c-4d6f-bdfc-f3b6e67a3443 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:24.776255 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee6fd-858c-4d6f-bdfc-f3b6e67a3443 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:24.784680 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ee6fd-858c-4d6f-bdfc-f3b6e67a3443 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:24.786271 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ee6fd-858c-4d6f-bdfc-f3b6e67a3443 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-1e1ee6fd-858c-4d6f-bdfc-f3b6e67a3443 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:24.802134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:24.803188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:24.804139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 327/653] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:24.806511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67db92-12ae-4c0a-99d6-74a5406c225e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:24.806642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ee6fd-858c-4d6f-bdfc-f3b6e67a3443 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:24.810168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67db92-12ae-4c0a-99d6-74a5406c225e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:24.810168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67db92-12ae-4c0a-99d6-74a5406c225e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:24.810168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67db92-12ae-4c0a-99d6-74a5406c225e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:24.821132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67db92-12ae-4c0a-99d6-74a5406c225e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:24.822799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67db92-12ae-4c0a-99d6-74a5406c225e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-bd67db92-12ae-4c0a-99d6-74a5406c225e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:24.843040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:24.844173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:24.846063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:24.846063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:24.846063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:24.846063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:24.846892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:24.853420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 327/654] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:24.853420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67db92-12ae-4c0a-99d6-74a5406c225e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:24.937686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ee6fd-858c-4d6f-bdfc-f3b6e67a3443 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.958348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:24.970720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67db92-12ae-4c0a-99d6-74a5406c225e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:24.980327 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1b110-d98b-4df2-a101-bc84ce6accf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:24.981299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1b110-d98b-4df2-a101-bc84ce6accf5 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:24.981424 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1b110-d98b-4df2-a101-bc84ce6accf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:24.981633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1b110-d98b-4df2-a101-bc84ce6accf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.010690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b99825-e864-4754-93d6-cc1a07e589f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:25.011750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99825-e864-4754-93d6-cc1a07e589f8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:25.012239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99825-e864-4754-93d6-cc1a07e589f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:25.012666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b99825-e864-4754-93d6-cc1a07e589f8 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.013892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b99825-e864-4754-93d6-cc1a07e589f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:25.014373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b99825-e864-4754-93d6-cc1a07e589f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.016093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b99825-e864-4754-93d6-cc1a07e589f8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.036255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 328/655] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jun 23 10:37:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:25.037518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b99825-e864-4754-93d6-cc1a07e589f8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:25.060983 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1b110-d98b-4df2-a101-bc84ce6accf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.062368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1b110-d98b-4df2-a101-bc84ce6accf5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.098337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:25.148590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b99825-e864-4754-93d6-cc1a07e589f8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:25.172835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 328/656] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:37:25.174079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1b110-d98b-4df2-a101-bc84ce6accf5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:25.187013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3a54-042e-4d2d-840c-ed18b8549c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:25.187625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3a54-042e-4d2d-840c-ed18b8549c7b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:25.188010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3a54-042e-4d2d-840c-ed18b8549c7b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:25.188394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3a54-042e-4d2d-840c-ed18b8549c7b None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.189225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3a54-042e-4d2d-840c-ed18b8549c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:25.189654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3a54-042e-4d2d-840c-ed18b8549c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.191808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3a54-042e-4d2d-840c-ed18b8549c7b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.194740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:25.207211 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 329/657] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:25.208247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3a54-042e-4d2d-840c-ed18b8549c7b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:25.283083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1b110-d98b-4df2-a101-bc84ce6accf5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:25.317477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3a54-042e-4d2d-840c-ed18b8549c7b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:25.322156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b07e1f-bab6-4bf5-a563-852d9d4b2299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:25.323054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b07e1f-bab6-4bf5-a563-852d9d4b2299 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:25.323483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b07e1f-bab6-4bf5-a563-852d9d4b2299 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:25.324059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b07e1f-bab6-4bf5-a563-852d9d4b2299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.337775 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:25.357914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5352c3c-b65a-4ea1-a218-4867b3e90ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:25.358837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5352c3c-b65a-4ea1-a218-4867b3e90ddd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:25.359217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5352c3c-b65a-4ea1-a218-4867b3e90ddd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:25.359602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5352c3c-b65a-4ea1-a218-4867b3e90ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.372541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5352c3c-b65a-4ea1-a218-4867b3e90ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.374412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5352c3c-b65a-4ea1-a218-4867b3e90ddd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-c5352c3c-b65a-4ea1-a218-4867b3e90ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:25.393461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:25.394611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:25.395578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:25.395578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:25.395578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:25.395578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:25.396549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 330/658] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:25.397502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5352c3c-b65a-4ea1-a218-4867b3e90ddd None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:25.407437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b07e1f-bab6-4bf5-a563-852d9d4b2299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.409182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b07e1f-bab6-4bf5-a563-852d9d4b2299 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.429096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:25.511600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5352c3c-b65a-4ea1-a218-4867b3e90ddd None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:25.532006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 329/659] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:37:25.533359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b07e1f-bab6-4bf5-a563-852d9d4b2299 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:25.562292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1191f1-4a3b-4743-809e-496a672542dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:25.563090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1191f1-4a3b-4743-809e-496a672542dd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:25.563448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1191f1-4a3b-4743-809e-496a672542dd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:25.563820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1191f1-4a3b-4743-809e-496a672542dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.572953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1191f1-4a3b-4743-809e-496a672542dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.575422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1191f1-4a3b-4743-809e-496a672542dd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-2c1191f1-4a3b-4743-809e-496a672542dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:25.591000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:25.592023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:25.592989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 331/660] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:25.593599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1191f1-4a3b-4743-809e-496a672542dd None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:25.626119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:25.656249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b07e1f-bab6-4bf5-a563-852d9d4b2299 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:25.675110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:25.697142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022e951-73d1-4ce9-9f95-b7411624f708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:25.698100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022e951-73d1-4ce9-9f95-b7411624f708 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:25.698698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022e951-73d1-4ce9-9f95-b7411624f708 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:25.699178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022e951-73d1-4ce9-9f95-b7411624f708 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.700269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022e951-73d1-4ce9-9f95-b7411624f708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:25.700760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022e951-73d1-4ce9-9f95-b7411624f708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.702674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022e951-73d1-4ce9-9f95-b7411624f708 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.705567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1191f1-4a3b-4743-809e-496a672542dd None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:25.716201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 330/661] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:25.717456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022e951-73d1-4ce9-9f95-b7411624f708 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:25.744905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55fab6-5253-4e21-a465-a5cf6b1ad360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:25.745862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55fab6-5253-4e21-a465-a5cf6b1ad360 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:25.746250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55fab6-5253-4e21-a465-a5cf6b1ad360 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:25.746592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55fab6-5253-4e21-a465-a5cf6b1ad360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.759666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55fab6-5253-4e21-a465-a5cf6b1ad360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.761426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55fab6-5253-4e21-a465-a5cf6b1ad360 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-de55fab6-5253-4e21-a465-a5cf6b1ad360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:25.780539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:25.781592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:25.782547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:25.782547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:25.782547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:25.782547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:25.786586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 332/662] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:25.787664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55fab6-5253-4e21-a465-a5cf6b1ad360 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:25.829884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022e951-73d1-4ce9-9f95-b7411624f708 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:25.866633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba440d8-b7e6-494d-b79f-eb83884e9183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:25.868230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba440d8-b7e6-494d-b79f-eb83884e9183 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:25.868690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba440d8-b7e6-494d-b79f-eb83884e9183 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:25.869137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba440d8-b7e6-494d-b79f-eb83884e9183 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.870147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba440d8-b7e6-494d-b79f-eb83884e9183 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:25.870664 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba440d8-b7e6-494d-b79f-eb83884e9183 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.872332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba440d8-b7e6-494d-b79f-eb83884e9183 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.877609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:25.894375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 331/663] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:25.895609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba440d8-b7e6-494d-b79f-eb83884e9183 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:25.897969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55fab6-5253-4e21-a465-a5cf6b1ad360 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:25.937369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:25.947884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16bc81-dcf9-419e-bddb-aaa86ab7a39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:25.948877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16bc81-dcf9-419e-bddb-aaa86ab7a39d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:25.949284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16bc81-dcf9-419e-bddb-aaa86ab7a39d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:25.949687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16bc81-dcf9-419e-bddb-aaa86ab7a39d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:25.959055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16bc81-dcf9-419e-bddb-aaa86ab7a39d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:25.961178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16bc81-dcf9-419e-bddb-aaa86ab7a39d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-2e16bc81-dcf9-419e-bddb-aaa86ab7a39d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:25.978064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:25.979499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 333/664] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:25.980422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16bc81-dcf9-419e-bddb-aaa86ab7a39d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:26.025142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba440d8-b7e6-494d-b79f-eb83884e9183 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.066822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac965b1-2a87-49a4-a649-d1b2b3bc3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.067861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac965b1-2a87-49a4-a649-d1b2b3bc3f0b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.068367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac965b1-2a87-49a4-a649-d1b2b3bc3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.068840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac965b1-2a87-49a4-a649-d1b2b3bc3f0b None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.069765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac965b1-2a87-49a4-a649-d1b2b3bc3f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:26.070745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac965b1-2a87-49a4-a649-d1b2b3bc3f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:26.072166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac965b1-2a87-49a4-a649-d1b2b3bc3f0b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:26.084459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 332/665] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:26.085542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9d39-58fd-4f59-bbfa-1093ea6c5411 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.085867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9d39-58fd-4f59-bbfa-1093ea6c5411 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.086154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9d39-58fd-4f59-bbfa-1093ea6c5411 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.087567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 333/666] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:26.088145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce9d39-58fd-4f59-bbfa-1093ea6c5411 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:26.104194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16bc81-dcf9-419e-bddb-aaa86ab7a39d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.143490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccabcc7-e8a6-4fa3-86a8-28f2f05e0a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.144045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccabcc7-e8a6-4fa3-86a8-28f2f05e0a01 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.144327 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccabcc7-e8a6-4fa3-86a8-28f2f05e0a01 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.144717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccabcc7-e8a6-4fa3-86a8-28f2f05e0a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.157295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:26.194742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:26.203795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce9d39-58fd-4f59-bbfa-1093ea6c5411 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.226609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccabcc7-e8a6-4fa3-86a8-28f2f05e0a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:26.228266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccabcc7-e8a6-4fa3-86a8-28f2f05e0a01 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:26.241841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0dee-0312-464c-aaad-7454c79f2a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.243378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0dee-0312-464c-aaad-7454c79f2a94 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.243378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0dee-0312-464c-aaad-7454c79f2a94 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.243661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0dee-0312-464c-aaad-7454c79f2a94 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.244383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd0dee-0312-464c-aaad-7454c79f2a94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:26.244692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd0dee-0312-464c-aaad-7454c79f2a94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:26.246133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd0dee-0312-464c-aaad-7454c79f2a94 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:26.264606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 334/667] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:26.265354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0dee-0312-464c-aaad-7454c79f2a94 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:26.342191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 334/668] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:37:26.343511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7c0ad-d39d-439d-9364-c293ed011b1f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.343883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7c0ad-d39d-439d-9364-c293ed011b1f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.344226 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7c0ad-d39d-439d-9364-c293ed011b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.361732 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0bc7c0ad-d39d-439d-9364-c293ed011b1f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:26.362989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0bc7c0ad-d39d-439d-9364-c293ed011b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:26.382674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0dee-0312-464c-aaad-7454c79f2a94 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.403806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:26.423412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c41f88-5c3b-4a25-98dd-afe887cb1d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.424266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41f88-5c3b-4a25-98dd-afe887cb1d71 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.424550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41f88-5c3b-4a25-98dd-afe887cb1d71 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.424875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c41f88-5c3b-4a25-98dd-afe887cb1d71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.432611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c41f88-5c3b-4a25-98dd-afe887cb1d71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:26.434065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c41f88-5c3b-4a25-98dd-afe887cb1d71 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:26.450344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 335/669] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:26.450344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7c0ad-d39d-439d-9364-c293ed011b1f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-29c41f88-5c3b-4a25-98dd-afe887cb1d71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:26.450648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:26.452068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:26.453516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:26.453516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:26.453516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:26.453516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:26.453516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:26.453516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:26.453516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:26.453516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:26.453516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 335/670] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:26.455663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c41f88-5c3b-4a25-98dd-afe887cb1d71 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:26.474627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:26.562198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7c0ad-d39d-439d-9364-c293ed011b1f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.568237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c41f88-5c3b-4a25-98dd-afe887cb1d71 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.598404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e41b-0b7f-4780-8f35-8f441313fc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.598987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e41b-0b7f-4780-8f35-8f441313fc1e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.599271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e41b-0b7f-4780-8f35-8f441313fc1e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.599549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e41b-0b7f-4780-8f35-8f441313fc1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.600414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e41b-0b7f-4780-8f35-8f441313fc1e None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=0930d783a2574d5caeb2587fe4157cf8) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:26.600727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e41b-0b7f-4780-8f35-8f441313fc1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:26.602764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e41b-0b7f-4780-8f35-8f441313fc1e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:26.602865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135534-a586-4e4b-a757-0c175276b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.603619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135534-a586-4e4b-a757-0c175276b555 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.603886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135534-a586-4e4b-a757-0c175276b555 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.604165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d135534-a586-4e4b-a757-0c175276b555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.608602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 336/671] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:26 2022] GET /identity/v3/role_assignments?user.id=0930d783a2574d5caeb2587fe4157cf8&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:26.609480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e41b-0b7f-4780-8f35-8f441313fc1e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:26.615974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d135534-a586-4e4b-a757-0c175276b555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:26.618397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d135534-a586-4e4b-a757-0c175276b555 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-3d135534-a586-4e4b-a757-0c175276b555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:26.639339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:26.640525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:26.641617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:26.641617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:26.641617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:26.641617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:26.641617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 336/672] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:26.641617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135534-a586-4e4b-a757-0c175276b555 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:26.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:26.721508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:26.733661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e41b-0b7f-4780-8f35-8f441313fc1e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.769296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d135534-a586-4e4b-a757-0c175276b555 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.783602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e269-43a4-4e8f-98f4-4bc22a014261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.784292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e269-43a4-4e8f-98f4-4bc22a014261 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.784576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e269-43a4-4e8f-98f4-4bc22a014261 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.784932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e269-43a4-4e8f-98f4-4bc22a014261 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.785739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e269-43a4-4e8f-98f4-4bc22a014261 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:26.786077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e269-43a4-4e8f-98f4-4bc22a014261 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:26.788031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e269-43a4-4e8f-98f4-4bc22a014261 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:26.806394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 337/673] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:26.806394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf9c0c-1465-4704-9e29-ac47920f61ac None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.806394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf9c0c-1465-4704-9e29-ac47920f61ac None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.806394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf9c0c-1465-4704-9e29-ac47920f61ac None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.807103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 338/674] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:26.808196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf9c0c-1465-4704-9e29-ac47920f61ac None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:26.813871 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd85d3c-14b7-4225-b82c-386f0889c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.815447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd85d3c-14b7-4225-b82c-386f0889c182 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.815447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd85d3c-14b7-4225-b82c-386f0889c182 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.815447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd85d3c-14b7-4225-b82c-386f0889c182 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.829677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd85d3c-14b7-4225-b82c-386f0889c182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-bfd85d3c-14b7-4225-b82c-386f0889c182 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:26.837603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:26.838736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:26.839599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 337/675] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:26.840313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd85d3c-14b7-4225-b82c-386f0889c182 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:26.919100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:26.929302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf9c0c-1465-4704-9e29-ac47920f61ac None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.955098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd85d3c-14b7-4225-b82c-386f0889c182 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:26.971681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f287d17-2159-4a2c-9470-36ed076ea963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.972867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287d17-2159-4a2c-9470-36ed076ea963 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.973329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287d17-2159-4a2c-9470-36ed076ea963 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.973740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287d17-2159-4a2c-9470-36ed076ea963 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:26.974790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f287d17-2159-4a2c-9470-36ed076ea963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:26.975241 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f287d17-2159-4a2c-9470-36ed076ea963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:26.977775 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f287d17-2159-4a2c-9470-36ed076ea963 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:26.986759 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:26.996248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dc186-09f1-421f-8506-c67f68eb5e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:26.996663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 339/676] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:26.997970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2136b6b-9c44-4c3b-8080-4a8dc8889a15 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:26.998262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2136b6b-9c44-4c3b-8080-4a8dc8889a15 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:26.998581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2136b6b-9c44-4c3b-8080-4a8dc8889a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.001288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dc186-09f1-421f-8506-c67f68eb5e88 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:27.001586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dc186-09f1-421f-8506-c67f68eb5e88 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:27.001872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74dc186-09f1-421f-8506-c67f68eb5e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.002774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dc186-09f1-421f-8506-c67f68eb5e88 None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=33a1696d1cc14ca6ac1cb970598f11fa) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:27.003099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dc186-09f1-421f-8506-c67f68eb5e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:27.004635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74dc186-09f1-421f-8506-c67f68eb5e88 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:27.011456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 338/677] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:26 2022] GET /identity/v3/role_assignments?user.id=33a1696d1cc14ca6ac1cb970598f11fa&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:27.012294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dc186-09f1-421f-8506-c67f68eb5e88 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.028185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c2136b6b-9c44-4c3b-8080-4a8dc8889a15 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:27.029935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c2136b6b-9c44-4c3b-8080-4a8dc8889a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:27.125794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 340/678] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:27.127107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2136b6b-9c44-4c3b-8080-4a8dc8889a15 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.169856 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74dc186-09f1-421f-8506-c67f68eb5e88 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:27.219492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1d7f2-ddc4-4c69-bed9-4a847c18eec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:27.220169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d7f2-ddc4-4c69-bed9-4a847c18eec6 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:27.221540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d7f2-ddc4-4c69-bed9-4a847c18eec6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:27.221540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d7f2-ddc4-4c69-bed9-4a847c18eec6 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.221540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d7f2-ddc4-4c69-bed9-4a847c18eec6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:27.221802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d7f2-ddc4-4c69-bed9-4a847c18eec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:27.223205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d7f2-ddc4-4c69-bed9-4a847c18eec6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:27.236274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 339/679] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:27.237506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1d7f2-ddc4-4c69-bed9-4a847c18eec6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.256152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:27.274902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2136b6b-9c44-4c3b-8080-4a8dc8889a15 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:27.308845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:27.325246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5bd6-cf69-4949-9992-771127cc30a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:27.325790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5bd6-cf69-4949-9992-771127cc30a9 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:27.326074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5bd6-cf69-4949-9992-771127cc30a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:27.326375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5bd6-cf69-4949-9992-771127cc30a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.336366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf5bd6-cf69-4949-9992-771127cc30a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:27.337913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf5bd6-cf69-4949-9992-771127cc30a9 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-24bf5bd6-cf69-4949-9992-771127cc30a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:27.353730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:27.355022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 341/680] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:27.357381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5bd6-cf69-4949-9992-771127cc30a9 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.386676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1d7f2-ddc4-4c69-bed9-4a847c18eec6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:27.427609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80ec84-20b2-420d-a543-79b6674c134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:27.428951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80ec84-20b2-420d-a543-79b6674c134c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:27.430062 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80ec84-20b2-420d-a543-79b6674c134c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:27.430557 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80ec84-20b2-420d-a543-79b6674c134c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.443347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80ec84-20b2-420d-a543-79b6674c134c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-9a80ec84-20b2-420d-a543-79b6674c134c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:27.452020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:27.453010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:27.453894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:27.456318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 340/681] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:27.457260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80ec84-20b2-420d-a543-79b6674c134c None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.496514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5bd6-cf69-4949-9992-771127cc30a9 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:27.533074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25a4ca-3110-4abf-bbb9-10986495c27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:27.533871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a4ca-3110-4abf-bbb9-10986495c27d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:27.534163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a4ca-3110-4abf-bbb9-10986495c27d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:27.534502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25a4ca-3110-4abf-bbb9-10986495c27d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.547640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25a4ca-3110-4abf-bbb9-10986495c27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:27.549237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25a4ca-3110-4abf-bbb9-10986495c27d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:27.552119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-cf25a4ca-3110-4abf-bbb9-10986495c27d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:27.569395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:27.570830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:27.571884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:27.571884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:27.571884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:27.571884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:27.575368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 342/682] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:27.576231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25a4ca-3110-4abf-bbb9-10986495c27d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.580734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80ec84-20b2-420d-a543-79b6674c134c None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:27.595112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:27.621676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262417c-83dd-4d4a-bfbd-f2ab9a423a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:27.622704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262417c-83dd-4d4a-bfbd-f2ab9a423a17 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:27.623280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262417c-83dd-4d4a-bfbd-f2ab9a423a17 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:27.623773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262417c-83dd-4d4a-bfbd-f2ab9a423a17 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.624751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262417c-83dd-4d4a-bfbd-f2ab9a423a17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:27.625355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262417c-83dd-4d4a-bfbd-f2ab9a423a17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:27.627122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262417c-83dd-4d4a-bfbd-f2ab9a423a17 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:27.641284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 341/683] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:27.642501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262417c-83dd-4d4a-bfbd-f2ab9a423a17 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.690458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25a4ca-3110-4abf-bbb9-10986495c27d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:27.725794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64b7e-ee66-4f6b-abc1-2d2d60585fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:27.727081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64b7e-ee66-4f6b-abc1-2d2d60585fbe None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:27.727371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64b7e-ee66-4f6b-abc1-2d2d60585fbe None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:27.727653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d64b7e-ee66-4f6b-abc1-2d2d60585fbe None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.728415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d64b7e-ee66-4f6b-abc1-2d2d60585fbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:27.728726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d64b7e-ee66-4f6b-abc1-2d2d60585fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:27.730119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d64b7e-ee66-4f6b-abc1-2d2d60585fbe None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:27.739615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 343/684] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:27.740564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64b7e-ee66-4f6b-abc1-2d2d60585fbe None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.765328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262417c-83dd-4d4a-bfbd-f2ab9a423a17 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:27.804713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f436ff-fab4-4ca2-8d59-34560faf146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:27.805378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f436ff-fab4-4ca2-8d59-34560faf146a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:27.805747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f436ff-fab4-4ca2-8d59-34560faf146a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:27.806117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f436ff-fab4-4ca2-8d59-34560faf146a None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.807014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f436ff-fab4-4ca2-8d59-34560faf146a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:27.807399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f436ff-fab4-4ca2-8d59-34560faf146a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:27.808821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:27.809528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f436ff-fab4-4ca2-8d59-34560faf146a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:27.832999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 342/685] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:27.832999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f436ff-fab4-4ca2-8d59-34560faf146a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.870404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:27.877540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d64b7e-ee66-4f6b-abc1-2d2d60585fbe None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:27.914191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff87a1e-b26f-42d8-872c-f7afff60ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:27.915502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff87a1e-b26f-42d8-872c-f7afff60ab19 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:27.916000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff87a1e-b26f-42d8-872c-f7afff60ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:27.917010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff87a1e-b26f-42d8-872c-f7afff60ab19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:27.918488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff87a1e-b26f-42d8-872c-f7afff60ab19 None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=ed8f21a950d6483abc7ab67fb533942a) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:27.919041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff87a1e-b26f-42d8-872c-f7afff60ab19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:27.921686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff87a1e-b26f-42d8-872c-f7afff60ab19 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:27.930181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 344/686] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/role_assignments?user.id=ed8f21a950d6483abc7ab67fb533942a&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:27.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff87a1e-b26f-42d8-872c-f7afff60ab19 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:27.958995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f436ff-fab4-4ca2-8d59-34560faf146a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:28.010613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af093749-84f5-4517-a761-9de5e8fa3ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:28.012561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af093749-84f5-4517-a761-9de5e8fa3ecd None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:28.013354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af093749-84f5-4517-a761-9de5e8fa3ecd None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:28.013879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af093749-84f5-4517-a761-9de5e8fa3ecd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:28.031456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af093749-84f5-4517-a761-9de5e8fa3ecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:28.033273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af093749-84f5-4517-a761-9de5e8fa3ecd None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-af093749-84f5-4517-a761-9de5e8fa3ecd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:28.059893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:28.060885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:28.061798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:28.061798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:28.061798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:28.061798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:28.063914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 343/687] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:28.070592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff87a1e-b26f-42d8-872c-f7afff60ab19 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:28.074474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af093749-84f5-4517-a761-9de5e8fa3ecd None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:28.114708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:28.138748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43dd4c-ee0d-4f82-91ec-79e9c29c71ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:28.140895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43dd4c-ee0d-4f82-91ec-79e9c29c71ce None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:28.141179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43dd4c-ee0d-4f82-91ec-79e9c29c71ce None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:28.141465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43dd4c-ee0d-4f82-91ec-79e9c29c71ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:28.162260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43dd4c-ee0d-4f82-91ec-79e9c29c71ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:28.163722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43dd4c-ee0d-4f82-91ec-79e9c29c71ce None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-dd43dd4c-ee0d-4f82-91ec-79e9c29c71ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:28.191961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:28.192977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:28.193946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 345/688] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:28.203302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43dd4c-ee0d-4f82-91ec-79e9c29c71ce None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:28.224130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:28.252112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af093749-84f5-4517-a761-9de5e8fa3ecd None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:28.309035 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fa824-817e-444e-952e-827947487e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:28.310086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fa824-817e-444e-952e-827947487e3b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:28.310649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fa824-817e-444e-952e-827947487e3b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:28.311161 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fa824-817e-444e-952e-827947487e3b None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:28.312213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fa824-817e-444e-952e-827947487e3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:28.312751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fa824-817e-444e-952e-827947487e3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:28.314486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fa824-817e-444e-952e-827947487e3b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:28.331803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 344/689] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:28.343379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fa824-817e-444e-952e-827947487e3b None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:28.362218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43dd4c-ee0d-4f82-91ec-79e9c29c71ce None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:28.406819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386911a-d3ff-436b-bbed-6656e6459562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:28.407529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386911a-d3ff-436b-bbed-6656e6459562 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:28.407816 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386911a-d3ff-436b-bbed-6656e6459562 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:28.408089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386911a-d3ff-436b-bbed-6656e6459562 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:28.408965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386911a-d3ff-436b-bbed-6656e6459562 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:28.409280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386911a-d3ff-436b-bbed-6656e6459562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:28.410770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386911a-d3ff-436b-bbed-6656e6459562 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:28.448663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 346/690] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 23 10:37:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:28.456262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386911a-d3ff-436b-bbed-6656e6459562 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:28.510465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:28.586343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fa824-817e-444e-952e-827947487e3b None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:28.594012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386911a-d3ff-436b-bbed-6656e6459562 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:28.628255 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b477ed-0cd2-4175-a496-18a64e263411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:28.634343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b477ed-0cd2-4175-a496-18a64e263411 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:28.634343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b477ed-0cd2-4175-a496-18a64e263411 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:28.634343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b477ed-0cd2-4175-a496-18a64e263411 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:28.637966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b477ed-0cd2-4175-a496-18a64e263411 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:28.639732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b477ed-0cd2-4175-a496-18a64e263411 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:28.647605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02697fc-5386-4ffd-9ee5-690a9e345314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:28.649072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02697fc-5386-4ffd-9ee5-690a9e345314 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:28.649580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02697fc-5386-4ffd-9ee5-690a9e345314 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:28.650080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02697fc-5386-4ffd-9ee5-690a9e345314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-69b477ed-0cd2-4175-a496-18a64e263411 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:28.655635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:28.656586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:28.657631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 345/691] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 23 10:37:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:28.663906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b477ed-0cd2-4175-a496-18a64e263411 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:28.686345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:28.755450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02697fc-5386-4ffd-9ee5-690a9e345314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:28.757370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02697fc-5386-4ffd-9ee5-690a9e345314 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:28.838707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:28.891835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b477ed-0cd2-4175-a496-18a64e263411 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:28.956000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 347/692] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:37:28.956971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02697fc-5386-4ffd-9ee5-690a9e345314 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:28.967148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc220cf-44e9-4736-9dd9-a7670108048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:28.968716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc220cf-44e9-4736-9dd9-a7670108048f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:28.969007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc220cf-44e9-4736-9dd9-a7670108048f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:28.969289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc220cf-44e9-4736-9dd9-a7670108048f None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:28.970152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc220cf-44e9-4736-9dd9-a7670108048f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:28.970496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc220cf-44e9-4736-9dd9-a7670108048f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:28.971958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc220cf-44e9-4736-9dd9-a7670108048f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:28.992875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 346/693] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 23 10:37:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:28.999145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc220cf-44e9-4736-9dd9-a7670108048f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:29.081106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:29.112053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02697fc-5386-4ffd-9ee5-690a9e345314 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:29.123907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc220cf-44e9-4736-9dd9-a7670108048f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:29.149165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19903c85-1362-434f-8681-3e5df1b2cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:29.149966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19903c85-1362-434f-8681-3e5df1b2cd9a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.150250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19903c85-1362-434f-8681-3e5df1b2cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.150560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19903c85-1362-434f-8681-3e5df1b2cd9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.160270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c4adb-22e7-49a2-b2cd-6e8b459299c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:29.160928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c4adb-22e7-49a2-b2cd-6e8b459299c4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.161212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c4adb-22e7-49a2-b2cd-6e8b459299c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.161336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19903c85-1362-434f-8681-3e5df1b2cd9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:29.161506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c4adb-22e7-49a2-b2cd-6e8b459299c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.162849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19903c85-1362-434f-8681-3e5df1b2cd9a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:29.163454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-19903c85-1362-434f-8681-3e5df1b2cd9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:29.189090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:29.190363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:29.191301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:29.191301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:29.191301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:29.191301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:29.196369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 348/694] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:29.196369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c26c-dd9f-4df6-ad11-1c0a51aa60e1 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.196369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c26c-dd9f-4df6-ad11-1c0a51aa60e1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.196369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c26c-dd9f-4df6-ad11-1c0a51aa60e1 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.204724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 349/695] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:29.206187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07c26c-dd9f-4df6-ad11-1c0a51aa60e1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:29.235839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c4adb-22e7-49a2-b2cd-6e8b459299c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:29.237307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c4adb-22e7-49a2-b2cd-6e8b459299c4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:29.302748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:29.340347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07c26c-dd9f-4df6-ad11-1c0a51aa60e1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:29.346306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 347/696] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:37:29.347704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089636b9-4645-4123-b4a6-e9b9506c7b20 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.348066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089636b9-4645-4123-b4a6-e9b9506c7b20 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.348419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089636b9-4645-4123-b4a6-e9b9506c7b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.368345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-089636b9-4645-4123-b4a6-e9b9506c7b20 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:29.370354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-089636b9-4645-4123-b4a6-e9b9506c7b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:29.386709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9146a-0dfe-4140-9901-697a6d062f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:29.387441 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9146a-0dfe-4140-9901-697a6d062f84 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.387730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9146a-0dfe-4140-9901-697a6d062f84 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.388013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9146a-0dfe-4140-9901-697a6d062f84 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.388888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9146a-0dfe-4140-9901-697a6d062f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:29.389326 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9146a-0dfe-4140-9901-697a6d062f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:29.390937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9146a-0dfe-4140-9901-697a6d062f84 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:29.405585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 350/697] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:29.406544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9146a-0dfe-4140-9901-697a6d062f84 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:29.448257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 348/698] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:29.449014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089636b9-4645-4123-b4a6-e9b9506c7b20 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:29.475859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:29.533033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9146a-0dfe-4140-9901-697a6d062f84 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:29.559097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:29.568854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089636b9-4645-4123-b4a6-e9b9506c7b20 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:29.570573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026895-0833-4da3-956a-9f75a80a44bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:29.571492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026895-0833-4da3-956a-9f75a80a44bc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.571783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026895-0833-4da3-956a-9f75a80a44bc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.572658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026895-0833-4da3-956a-9f75a80a44bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.583422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03026895-0833-4da3-956a-9f75a80a44bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:29.585090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03026895-0833-4da3-956a-9f75a80a44bc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-03026895-0833-4da3-956a-9f75a80a44bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:29.604032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:29.604957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:29.605881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:29.605881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:29.605881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:29.605881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:29.605881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 351/699] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:29.606754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388ae8d-6b2f-42e4-9411-2ff8112a816a None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.606754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388ae8d-6b2f-42e4-9411-2ff8112a816a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.607009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388ae8d-6b2f-42e4-9411-2ff8112a816a None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.610495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 352/700] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:29.610495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388ae8d-6b2f-42e4-9411-2ff8112a816a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:29.611970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dccfb-a742-4888-8833-5170b2e07f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:29.612932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dccfb-a742-4888-8833-5170b2e07f55 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.613230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dccfb-a742-4888-8833-5170b2e07f55 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.613510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dccfb-a742-4888-8833-5170b2e07f55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.621538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dccfb-a742-4888-8833-5170b2e07f55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:29.623063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dccfb-a742-4888-8833-5170b2e07f55 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-a56dccfb-a742-4888-8833-5170b2e07f55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:29.637232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:29.638157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:29.639118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:29.639118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:29.639118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:29.639118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:29.639118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:29.639118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:29.639118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:29.639118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:29.639118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 349/701] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:29.639617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dccfb-a742-4888-8833-5170b2e07f55 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:29.731113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388ae8d-6b2f-42e4-9411-2ff8112a816a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:29.734228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:29.751695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dccfb-a742-4888-8833-5170b2e07f55 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:29.774188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211dc3-baf8-4230-8bbc-f6535b36cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:29.775052 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211dc3-baf8-4230-8bbc-f6535b36cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.775339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211dc3-baf8-4230-8bbc-f6535b36cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.775619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211dc3-baf8-4230-8bbc-f6535b36cbd1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.776606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211dc3-baf8-4230-8bbc-f6535b36cbd1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:29.777666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211dc3-baf8-4230-8bbc-f6535b36cbd1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:29.791985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e482591-d21c-4f9a-aa9e-7e49f3f920cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:29.792635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e482591-d21c-4f9a-aa9e-7e49f3f920cc None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.792923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e482591-d21c-4f9a-aa9e-7e49f3f920cc None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-d4211dc3-baf8-4230-8bbc-f6535b36cbd1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:29.793194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:29.794164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:37:29.800373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:29.801377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e482591-d21c-4f9a-aa9e-7e49f3f920cc None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.801377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e482591-d21c-4f9a-aa9e-7e49f3f920cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:29.801377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e482591-d21c-4f9a-aa9e-7e49f3f920cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:29.801604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 353/702] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 23 10:37:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:29.802256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e482591-d21c-4f9a-aa9e-7e49f3f920cc None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:29.802367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baded30-ee69-462c-98e0-916e441b708b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.802367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baded30-ee69-462c-98e0-916e441b708b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.802367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baded30-ee69-462c-98e0-916e441b708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.815205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 350/703] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:29.815571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e482591-d21c-4f9a-aa9e-7e49f3f920cc None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:29.825632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0baded30-ee69-462c-98e0-916e441b708b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:29.826865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0baded30-ee69-462c-98e0-916e441b708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:29.832437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:29.903594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 354/704] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:29.904760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baded30-ee69-462c-98e0-916e441b708b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:29.939660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e482591-d21c-4f9a-aa9e-7e49f3f920cc None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:29.982189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb19c1-fb60-4862-aaad-4ca85fefe207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:29.982985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb19c1-fb60-4862-aaad-4ca85fefe207 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:29.983343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb19c1-fb60-4862-aaad-4ca85fefe207 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:29.983699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb19c1-fb60-4862-aaad-4ca85fefe207 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:29.984499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb19c1-fb60-4862-aaad-4ca85fefe207 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:29.984873 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb19c1-fb60-4862-aaad-4ca85fefe207 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:29.986249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb19c1-fb60-4862-aaad-4ca85fefe207 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:29.998855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 351/705] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:30.003329 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb19c1-fb60-4862-aaad-4ca85fefe207 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:30.028774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:30.033345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baded30-ee69-462c-98e0-916e441b708b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:30.071446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22bd40-17a7-436b-9516-1fcf2747a196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:30.072117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22bd40-17a7-436b-9516-1fcf2747a196 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.072426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22bd40-17a7-436b-9516-1fcf2747a196 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.072683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22bd40-17a7-436b-9516-1fcf2747a196 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.073404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22bd40-17a7-436b-9516-1fcf2747a196 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:30.073716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22bd40-17a7-436b-9516-1fcf2747a196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:30.075189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22bd40-17a7-436b-9516-1fcf2747a196 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:30.082365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 355/706] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 23 10:37:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:30.082365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22bd40-17a7-436b-9516-1fcf2747a196 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:30.095735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:30.130905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb19c1-fb60-4862-aaad-4ca85fefe207 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:30.178193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed26e0-cce6-4d7b-b84b-f3daa53e9e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:30.180060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed26e0-cce6-4d7b-b84b-f3daa53e9e17 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.180851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed26e0-cce6-4d7b-b84b-f3daa53e9e17 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.181072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed26e0-cce6-4d7b-b84b-f3daa53e9e17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.189575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed26e0-cce6-4d7b-b84b-f3daa53e9e17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:30.191370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed26e0-cce6-4d7b-b84b-f3daa53e9e17 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:30.205254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22bd40-17a7-436b-9516-1fcf2747a196 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-06ed26e0-cce6-4d7b-b84b-f3daa53e9e17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:30.207458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:30.208564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:30.209733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:30.209733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:30.209733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:30.209733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:30.209733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:30.209733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:30.209733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:30.209733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:30.214482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 352/707] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:30.215706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed26e0-cce6-4d7b-b84b-f3daa53e9e17 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:30.251287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946241-bceb-4eb8-98cf-1ab8e084ac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:30.252083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946241-bceb-4eb8-98cf-1ab8e084ac7e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.252367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946241-bceb-4eb8-98cf-1ab8e084ac7e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.252749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946241-bceb-4eb8-98cf-1ab8e084ac7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.264261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946241-bceb-4eb8-98cf-1ab8e084ac7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:30.265711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946241-bceb-4eb8-98cf-1ab8e084ac7e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-fb946241-bceb-4eb8-98cf-1ab8e084ac7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:30.284945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:30.286190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:30.287383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:30.287383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:30.287383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:30.287383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:30.292297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 356/708] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:30.293242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946241-bceb-4eb8-98cf-1ab8e084ac7e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:30.310508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:30.338174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed26e0-cce6-4d7b-b84b-f3daa53e9e17 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:30.369243 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:30.375165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722bc04-518f-4515-99ce-77f516257c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:30.375825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722bc04-518f-4515-99ce-77f516257c7e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.376105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722bc04-518f-4515-99ce-77f516257c7e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.376377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722bc04-518f-4515-99ce-77f516257c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.377204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722bc04-518f-4515-99ce-77f516257c7e None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=cbf19adc48f0439b9cdcb1aaedd58a01) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:30.377515 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722bc04-518f-4515-99ce-77f516257c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:30.378971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722bc04-518f-4515-99ce-77f516257c7e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:30.385124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 353/709] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:30 2022] GET /identity/v3/role_assignments?user.id=cbf19adc48f0439b9cdcb1aaedd58a01&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:30.385931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722bc04-518f-4515-99ce-77f516257c7e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:30.412830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946241-bceb-4eb8-98cf-1ab8e084ac7e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:30.453403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3346239-eb1b-4d66-a19e-cf77a22e1134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:30.453990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3346239-eb1b-4d66-a19e-cf77a22e1134 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.454274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3346239-eb1b-4d66-a19e-cf77a22e1134 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.454583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3346239-eb1b-4d66-a19e-cf77a22e1134 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.455309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3346239-eb1b-4d66-a19e-cf77a22e1134 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:30.455619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3346239-eb1b-4d66-a19e-cf77a22e1134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:30.457052 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3346239-eb1b-4d66-a19e-cf77a22e1134 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:30.474357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 357/710] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 23 10:37:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:30.474357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3346239-eb1b-4d66-a19e-cf77a22e1134 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:30.589048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722bc04-518f-4515-99ce-77f516257c7e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:30.604335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:30.640222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3346239-eb1b-4d66-a19e-cf77a22e1134 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:30.640675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3010202-a62f-4dfd-ad5e-fb1e9cd2e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:30.641428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3010202-a62f-4dfd-ad5e-fb1e9cd2e95a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.642228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3010202-a62f-4dfd-ad5e-fb1e9cd2e95a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.642228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3010202-a62f-4dfd-ad5e-fb1e9cd2e95a None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.643006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3010202-a62f-4dfd-ad5e-fb1e9cd2e95a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:30.643682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3010202-a62f-4dfd-ad5e-fb1e9cd2e95a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:30.645050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3010202-a62f-4dfd-ad5e-fb1e9cd2e95a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:30.661728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 354/711] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:30.663379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d10b89-241e-434d-a860-50ffb694bc99 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.663778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d10b89-241e-434d-a860-50ffb694bc99 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.664184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d10b89-241e-434d-a860-50ffb694bc99 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.670005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 355/712] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:30.671205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d10b89-241e-434d-a860-50ffb694bc99 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:30.691686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c37bf0-1822-4058-9470-9c0f79cf8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:30.692586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c37bf0-1822-4058-9470-9c0f79cf8717 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.693061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c37bf0-1822-4058-9470-9c0f79cf8717 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.693594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c37bf0-1822-4058-9470-9c0f79cf8717 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.694769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c37bf0-1822-4058-9470-9c0f79cf8717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:30.695661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c37bf0-1822-4058-9470-9c0f79cf8717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:30.697257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c37bf0-1822-4058-9470-9c0f79cf8717 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:30.711339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 358/713] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:30.712619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b6d3-1575-4cfc-89ce-e7239fdb92b7 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.712934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b6d3-1575-4cfc-89ce-e7239fdb92b7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.713303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b6d3-1575-4cfc-89ce-e7239fdb92b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.732509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2130b6d3-1575-4cfc-89ce-e7239fdb92b7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:30.733951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2130b6d3-1575-4cfc-89ce-e7239fdb92b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:30.749985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:30.816452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 359/714] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:30.817248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130b6d3-1575-4cfc-89ce-e7239fdb92b7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:30.817456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d10b89-241e-434d-a860-50ffb694bc99 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:30.865334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd57f11-3ddc-47d5-84d1-9626e08fbf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:30.866112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd57f11-3ddc-47d5-84d1-9626e08fbf42 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:30.866282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd57f11-3ddc-47d5-84d1-9626e08fbf42 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:30.866597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd57f11-3ddc-47d5-84d1-9626e08fbf42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:30.868022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd57f11-3ddc-47d5-84d1-9626e08fbf42 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=0d639e845cfa4f10b8e86cd237664c9b) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:30.868362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd57f11-3ddc-47d5-84d1-9626e08fbf42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:30.869795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd57f11-3ddc-47d5-84d1-9626e08fbf42 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:30.882350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 356/715] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:30 2022] GET /identity/v3/role_assignments?user.id=0d639e845cfa4f10b8e86cd237664c9b&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:30.882350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd57f11-3ddc-47d5-84d1-9626e08fbf42 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:30.915562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:30.981647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130b6d3-1575-4cfc-89ce-e7239fdb92b7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:31.039235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bca1bd-9e07-46f0-88f2-8671f3cf0641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:31.040024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bca1bd-9e07-46f0-88f2-8671f3cf0641 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:31.040309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bca1bd-9e07-46f0-88f2-8671f3cf0641 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:31.040624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bca1bd-9e07-46f0-88f2-8671f3cf0641 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:31.041428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bca1bd-9e07-46f0-88f2-8671f3cf0641 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:31.042939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bca1bd-9e07-46f0-88f2-8671f3cf0641 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:31.053645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd57f11-3ddc-47d5-84d1-9626e08fbf42 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:31.066804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 360/716] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:37:30 2022] POST /identity/v3/users => generated 254 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:31.092753 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:31.117747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93be03-8ed6-46ee-8825-1b6a7d77b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:31.118737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93be03-8ed6-46ee-8825-1b6a7d77b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:31.119172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93be03-8ed6-46ee-8825-1b6a7d77b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:31.119458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93be03-8ed6-46ee-8825-1b6a7d77b8f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:31.120145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93be03-8ed6-46ee-8825-1b6a7d77b8f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:31.122029 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93be03-8ed6-46ee-8825-1b6a7d77b8f7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-fe93be03-8ed6-46ee-8825-1b6a7d77b8f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:31.138128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:31.139299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:31.140175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 357/717] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:30 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:31.148011 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bca1bd-9e07-46f0-88f2-8671f3cf0641 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:31.300077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bca1bd-9e07-46f0-88f2-8671f3cf0641 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:31.330711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:31.345383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57caed-220c-46ee-b1c3-46beae6f7c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:31.346221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57caed-220c-46ee-b1c3-46beae6f7c93 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:31.346537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57caed-220c-46ee-b1c3-46beae6f7c93 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:31.346818 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57caed-220c-46ee-b1c3-46beae6f7c93 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:31.347592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57caed-220c-46ee-b1c3-46beae6f7c93 None admin] RBAC: Adding query filter params (name=network) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:31.347932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57caed-220c-46ee-b1c3-46beae6f7c93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:31.350034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57caed-220c-46ee-b1c3-46beae6f7c93 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:31.355497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 361/718] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:37:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:31.361152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93be03-8ed6-46ee-8825-1b6a7d77b8f7 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:31.494605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93be03-8ed6-46ee-8825-1b6a7d77b8f7 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:31.533371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df522426-c343-47cf-aaa7-97c50a22b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:31.534037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df522426-c343-47cf-aaa7-97c50a22b065 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:31.534336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df522426-c343-47cf-aaa7-97c50a22b065 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:31.534627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df522426-c343-47cf-aaa7-97c50a22b065 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:31.537693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df522426-c343-47cf-aaa7-97c50a22b065 None admin] RBAC: Adding query filter params (type=network) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:31.537693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df522426-c343-47cf-aaa7-97c50a22b065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:31.537693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df522426-c343-47cf-aaa7-97c50a22b065 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:31.544986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 358/719] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:37:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:32.984554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb83c48-e61b-456e-9ac0-cba34fd3f0ab None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:32.985109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb83c48-e61b-456e-9ac0-cba34fd3f0ab None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:32.985109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb83c48-e61b-456e-9ac0-cba34fd3f0ab None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:32.986800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 362/720] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:32.992289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0491f8-0ece-4e47-8ec2-00135d4920ee None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:32.992847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0491f8-0ece-4e47-8ec2-00135d4920ee None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:32.992847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0491f8-0ece-4e47-8ec2-00135d4920ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:33.018532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-2c0491f8-0ece-4e47-8ec2-00135d4920ee None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:33.019754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2c0491f8-0ece-4e47-8ec2-00135d4920ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:33.081219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:33.120544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 359/721] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:33.175896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb83c48-e61b-456e-9ac0-cba34fd3f0ab None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:33.331016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb83c48-e61b-456e-9ac0-cba34fd3f0ab None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:33.383164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6205f-074b-4574-91ad-32471fa94533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:33.384009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6205f-074b-4574-91ad-32471fa94533 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:33.384300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6205f-074b-4574-91ad-32471fa94533 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:33.384581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6205f-074b-4574-91ad-32471fa94533 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:33.385340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6205f-074b-4574-91ad-32471fa94533 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:33.386793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6205f-074b-4574-91ad-32471fa94533 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:33.396965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1a235-943b-4ebe-8952-51e857e25fa1 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:33.397344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1a235-943b-4ebe-8952-51e857e25fa1 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:33.397611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1a235-943b-4ebe-8952-51e857e25fa1 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:33.400515 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 360/722] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:33.407293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ec75-0b9f-4ab4-be47-3e7fb9d52eb8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:33.407641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ec75-0b9f-4ab4-be47-3e7fb9d52eb8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:33.407932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ec75-0b9f-4ab4-be47-3e7fb9d52eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:33.416758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 363/723] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:37:33 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:33.439795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7699ec75-0b9f-4ab4-be47-3e7fb9d52eb8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:33.441740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7699ec75-0b9f-4ab4-be47-3e7fb9d52eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:33.563562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f739aa-1458-4f76-a752-6e08ff1f7c88 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:33.564003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f739aa-1458-4f76-a752-6e08ff1f7c88 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:33.564381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f739aa-1458-4f76-a752-6e08ff1f7c88 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:33.566392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 364/724] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:33.572984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b222f-293b-40de-bb87-66870e282be7 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:33.572984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b222f-293b-40de-bb87-66870e282be7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:33.573285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b222f-293b-40de-bb87-66870e282be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:33.574840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 361/725] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:33.599841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-1d8b222f-293b-40de-bb87-66870e282be7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:33.601009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-1d8b222f-293b-40de-bb87-66870e282be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:33.631780 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ec75-0b9f-4ab4-be47-3e7fb9d52eb8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:33.681862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:33.736804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 365/726] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:37:33.764008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b222f-293b-40de-bb87-66870e282be7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:33.785028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ec75-0b9f-4ab4-be47-3e7fb9d52eb8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:33.787492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:33.838562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43603e2-b2bd-4cf9-8a77-ee743d0d2acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:33.839384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43603e2-b2bd-4cf9-8a77-ee743d0d2acc None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:33.839671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43603e2-b2bd-4cf9-8a77-ee743d0d2acc None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:33.839956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43603e2-b2bd-4cf9-8a77-ee743d0d2acc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:33.860575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43603e2-b2bd-4cf9-8a77-ee743d0d2acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-c43603e2-b2bd-4cf9-8a77-ee743d0d2acc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:33.868657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:33.869665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:33.870585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:33.874719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 362/727] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:33.876143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43603e2-b2bd-4cf9-8a77-ee743d0d2acc None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:33.883884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b222f-293b-40de-bb87-66870e282be7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:33.935844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e03186-9619-467d-b842-83806f1c8892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:33.937086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e03186-9619-467d-b842-83806f1c8892 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:33.937595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e03186-9619-467d-b842-83806f1c8892 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:33.938110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e03186-9619-467d-b842-83806f1c8892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:33.951124 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e03186-9619-467d-b842-83806f1c8892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-79e03186-9619-467d-b842-83806f1c8892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:33.959756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:33.960844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:33.961720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:33.964808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 366/728] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:33.971066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e03186-9619-467d-b842-83806f1c8892 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:34.029152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43603e2-b2bd-4cf9-8a77-ee743d0d2acc None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:34.050983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:34.109115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee960-b987-4733-8b5a-b5900285b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:34.110158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee960-b987-4733-8b5a-b5900285b219 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.110746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee960-b987-4733-8b5a-b5900285b219 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.111256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ee960-b987-4733-8b5a-b5900285b219 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.113942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ee960-b987-4733-8b5a-b5900285b219 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:34.114520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ee960-b987-4733-8b5a-b5900285b219 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:34.116504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ee960-b987-4733-8b5a-b5900285b219 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:34.137435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 363/729] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:34.143697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee960-b987-4733-8b5a-b5900285b219 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:34.171324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e03186-9619-467d-b842-83806f1c8892 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:34.175026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:34.214837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851aab9-0ea2-48eb-9d73-9a6d867140ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:34.214837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851aab9-0ea2-48eb-9d73-9a6d867140ce None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.214837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851aab9-0ea2-48eb-9d73-9a6d867140ce None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.214837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851aab9-0ea2-48eb-9d73-9a6d867140ce None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.215348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851aab9-0ea2-48eb-9d73-9a6d867140ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:34.215348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851aab9-0ea2-48eb-9d73-9a6d867140ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:34.219842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851aab9-0ea2-48eb-9d73-9a6d867140ce None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:34.242889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 367/730] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:34.244051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851aab9-0ea2-48eb-9d73-9a6d867140ce None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:34.332739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ee960-b987-4733-8b5a-b5900285b219 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:34.395127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02d957-a324-4284-9493-0beb14d05d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:34.395863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d957-a324-4284-9493-0beb14d05d9b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.396150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d957-a324-4284-9493-0beb14d05d9b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.396432 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02d957-a324-4284-9493-0beb14d05d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.427996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02d957-a324-4284-9493-0beb14d05d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:34.430688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02d957-a324-4284-9493-0beb14d05d9b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:34.435633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:34.443810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851aab9-0ea2-48eb-9d73-9a6d867140ce None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-9c02d957-a324-4284-9493-0beb14d05d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:34.459032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:34.460127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:34.461770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:34.461770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:34.461770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:34.461770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:34.461770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 364/731] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:34.463548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1a4c-b7c2-4fb7-b346-00c46f8efab9 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.463548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1a4c-b7c2-4fb7-b346-00c46f8efab9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.463548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec1a4c-b7c2-4fb7-b346-00c46f8efab9 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.464775 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 365/732] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:34.469156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1a4c-b7c2-4fb7-b346-00c46f8efab9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:34.486802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf6b4b-cc37-48b0-8dae-45a403076e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:34.487983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf6b4b-cc37-48b0-8dae-45a403076e7c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.488488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf6b4b-cc37-48b0-8dae-45a403076e7c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.489003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf6b4b-cc37-48b0-8dae-45a403076e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.501875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf6b4b-cc37-48b0-8dae-45a403076e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:34.503900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf6b4b-cc37-48b0-8dae-45a403076e7c None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-9bdf6b4b-cc37-48b0-8dae-45a403076e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:34.522182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:34.524971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:34.528472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:34.528472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:34.528472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:34.528472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:34.528472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 368/733] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:34.528472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb5ea-cade-48f4-aba3-69b12a2e40bd None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.528472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb5ea-cade-48f4-aba3-69b12a2e40bd None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.528472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14deb5ea-cade-48f4-aba3-69b12a2e40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.547347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-14deb5ea-cade-48f4-aba3-69b12a2e40bd None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:34.548551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-14deb5ea-cade-48f4-aba3-69b12a2e40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:34.572603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:34.600231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec1a4c-b7c2-4fb7-b346-00c46f8efab9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:34.624835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 369/734] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:34.628379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85aa034-5d10-4d9c-b924-f7736bf31f5c None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.629157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85aa034-5d10-4d9c-b924-f7736bf31f5c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.629658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85aa034-5d10-4d9c-b924-f7736bf31f5c None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.632318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 370/735] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:34.633795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85aa034-5d10-4d9c-b924-f7736bf31f5c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:34.639758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19928bf9-f83c-4c63-baf0-3edbd6c8f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:34.640340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928bf9-f83c-4c63-baf0-3edbd6c8f39c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.640623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928bf9-f83c-4c63-baf0-3edbd6c8f39c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.640899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19928bf9-f83c-4c63-baf0-3edbd6c8f39c None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.641631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19928bf9-f83c-4c63-baf0-3edbd6c8f39c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:34.641942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19928bf9-f83c-4c63-baf0-3edbd6c8f39c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:34.643342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19928bf9-f83c-4c63-baf0-3edbd6c8f39c None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:34.656201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 366/736] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:34.657499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abfab9-d4f8-4891-9aac-c76f0a00d6be None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.657788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abfab9-d4f8-4891-9aac-c76f0a00d6be None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.658062 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abfab9-d4f8-4891-9aac-c76f0a00d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.675068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-58abfab9-d4f8-4891-9aac-c76f0a00d6be None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:34.676273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-58abfab9-d4f8-4891-9aac-c76f0a00d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:34.733065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:34.758352 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 367/737] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:37:34.758352 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abfab9-d4f8-4891-9aac-c76f0a00d6be None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:34.769648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85aa034-5d10-4d9c-b924-f7736bf31f5c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:34.808045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af308707-9ea9-4de2-a919-050f70bc1446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:34.808705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308707-9ea9-4de2-a919-050f70bc1446 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.808989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308707-9ea9-4de2-a919-050f70bc1446 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.809266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308707-9ea9-4de2-a919-050f70bc1446 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.809989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308707-9ea9-4de2-a919-050f70bc1446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:34.810295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308707-9ea9-4de2-a919-050f70bc1446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:34.811687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308707-9ea9-4de2-a919-050f70bc1446 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:34.827997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 371/738] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:34.827997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af308707-9ea9-4de2-a919-050f70bc1446 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:34.833296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:34.870647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abfab9-d4f8-4891-9aac-c76f0a00d6be None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:34.905504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9aa5f-f7d3-479b-9baf-d0912112d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:34.906173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9aa5f-f7d3-479b-9baf-d0912112d9b8 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:34.906561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9aa5f-f7d3-479b-9baf-d0912112d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:34.906972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9aa5f-f7d3-479b-9baf-d0912112d9b8 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:34.907701 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9aa5f-f7d3-479b-9baf-d0912112d9b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:34.909092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9aa5f-f7d3-479b-9baf-d0912112d9b8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:34.925525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 368/739] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:37:34 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:34.926175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9aa5f-f7d3-479b-9baf-d0912112d9b8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:34.949499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af308707-9ea9-4de2-a919-050f70bc1446 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.010664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20facc-a99c-454c-9132-0f0843466b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.011601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20facc-a99c-454c-9132-0f0843466b20 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.011895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20facc-a99c-454c-9132-0f0843466b20 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.012227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20facc-a99c-454c-9132-0f0843466b20 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.021897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20facc-a99c-454c-9132-0f0843466b20 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:35.024172 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20facc-a99c-454c-9132-0f0843466b20 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:35.026964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-0e20facc-a99c-454c-9132-0f0843466b20 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:35.043323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:35.044375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:35.045960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 372/740] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:35.046590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20facc-a99c-454c-9132-0f0843466b20 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:35.089140 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9aa5f-f7d3-479b-9baf-d0912112d9b8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.122536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:35.134107 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce607bb-96ee-4edc-a367-82c78faebbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.135139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce607bb-96ee-4edc-a367-82c78faebbb0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.135253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce607bb-96ee-4edc-a367-82c78faebbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.135504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce607bb-96ee-4edc-a367-82c78faebbb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.149813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce607bb-96ee-4edc-a367-82c78faebbb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-bce607bb-96ee-4edc-a367-82c78faebbb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:35.157615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:35.158630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:35.159497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 369/741] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:35.160203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce607bb-96ee-4edc-a367-82c78faebbb0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:35.177249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20facc-a99c-454c-9132-0f0843466b20 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.227987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57173-289f-4dce-ad32-63f1ad724904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.228930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57173-289f-4dce-ad32-63f1ad724904 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.229373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57173-289f-4dce-ad32-63f1ad724904 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.229750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57173-289f-4dce-ad32-63f1ad724904 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.238823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e57173-289f-4dce-ad32-63f1ad724904 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:35.240623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e57173-289f-4dce-ad32-63f1ad724904 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-14e57173-289f-4dce-ad32-63f1ad724904 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:35.256889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:35.258711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:35.259670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:35.264106 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 373/742] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 23 10:37:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:35.265194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57173-289f-4dce-ad32-63f1ad724904 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:35.274093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce607bb-96ee-4edc-a367-82c78faebbb0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.319708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef754781-d49a-4962-8aa5-ebef62c0764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.321684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef754781-d49a-4962-8aa5-ebef62c0764e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.321981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef754781-d49a-4962-8aa5-ebef62c0764e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.322264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef754781-d49a-4962-8aa5-ebef62c0764e None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.323171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef754781-d49a-4962-8aa5-ebef62c0764e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:35.323490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef754781-d49a-4962-8aa5-ebef62c0764e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:35.325587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef754781-d49a-4962-8aa5-ebef62c0764e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:35.331724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:35.355094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 370/743] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 23 10:37:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:35.356746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef754781-d49a-4962-8aa5-ebef62c0764e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:35.396205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57173-289f-4dce-ad32-63f1ad724904 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.425459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:35.448546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934917a8-2316-4355-82e3-1e75b8a5d768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.450059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934917a8-2316-4355-82e3-1e75b8a5d768 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.450887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934917a8-2316-4355-82e3-1e75b8a5d768 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.451429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934917a8-2316-4355-82e3-1e75b8a5d768 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.452511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934917a8-2316-4355-82e3-1e75b8a5d768 None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:35.453015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934917a8-2316-4355-82e3-1e75b8a5d768 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:35.455534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934917a8-2316-4355-82e3-1e75b8a5d768 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:35.474350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 374/744] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:35.474350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934917a8-2316-4355-82e3-1e75b8a5d768 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:35.504629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef754781-d49a-4962-8aa5-ebef62c0764e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.560553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2ca1d-7495-4d9b-8fb6-55cc6dda6ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.561573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2ca1d-7495-4d9b-8fb6-55cc6dda6ff2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.563172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2ca1d-7495-4d9b-8fb6-55cc6dda6ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.563465 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2ca1d-7495-4d9b-8fb6-55cc6dda6ff2 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.564648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2ca1d-7495-4d9b-8fb6-55cc6dda6ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:35.565216 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2ca1d-7495-4d9b-8fb6-55cc6dda6ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:35.566735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2ca1d-7495-4d9b-8fb6-55cc6dda6ff2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:35.598603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 371/745] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 23 10:37:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:35.598603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2ca1d-7495-4d9b-8fb6-55cc6dda6ff2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:35.617438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934917a8-2316-4355-82e3-1e75b8a5d768 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.638820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:35.653976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23526b-35c8-4341-b12a-2b915034c9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.654834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23526b-35c8-4341-b12a-2b915034c9eb None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.654948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23526b-35c8-4341-b12a-2b915034c9eb None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.655202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23526b-35c8-4341-b12a-2b915034c9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.716568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2ca1d-7495-4d9b-8fb6-55cc6dda6ff2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.719562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:35.727896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23526b-35c8-4341-b12a-2b915034c9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:35.729602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23526b-35c8-4341-b12a-2b915034c9eb None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:35.761281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec5467-c2d4-4514-b51c-bd43ec37d580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.762614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec5467-c2d4-4514-b51c-bd43ec37d580 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.763127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec5467-c2d4-4514-b51c-bd43ec37d580 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.763608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec5467-c2d4-4514-b51c-bd43ec37d580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.775709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec5467-c2d4-4514-b51c-bd43ec37d580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:35.777655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec5467-c2d4-4514-b51c-bd43ec37d580 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-3dec5467-c2d4-4514-b51c-bd43ec37d580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:35.798783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:35.799796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:35.800717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:35.800717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:35.800717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:35.800717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:35.808439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 372/746] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:35.809792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec5467-c2d4-4514-b51c-bd43ec37d580 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:35.845476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 375/747] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:37:35.846424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23526b-35c8-4341-b12a-2b915034c9eb None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:35.868568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:35.927396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec5467-c2d4-4514-b51c-bd43ec37d580 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.951669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23526b-35c8-4341-b12a-2b915034c9eb None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:35.965555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660841cd-820b-4b4b-8027-3931488f17e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.966376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660841cd-820b-4b4b-8027-3931488f17e0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.966730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660841cd-820b-4b4b-8027-3931488f17e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.966956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660841cd-820b-4b4b-8027-3931488f17e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.977632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660841cd-820b-4b4b-8027-3931488f17e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:35.979120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660841cd-820b-4b4b-8027-3931488f17e0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:35.990380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c54433-d56f-4dd5-ba39-9364fa33e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:35.991274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c54433-d56f-4dd5-ba39-9364fa33e233 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:35.991769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c54433-d56f-4dd5-ba39-9364fa33e233 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:35.992768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c54433-d56f-4dd5-ba39-9364fa33e233 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:35.993790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c54433-d56f-4dd5-ba39-9364fa33e233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:35.994281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c54433-d56f-4dd5-ba39-9364fa33e233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:35.995853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c54433-d56f-4dd5-ba39-9364fa33e233 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-660841cd-820b-4b4b-8027-3931488f17e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:35.997122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:35.998007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:35.999097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:35.999097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:35.999097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:35.999097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:36.002933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 373/748] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:36.003603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660841cd-820b-4b4b-8027-3931488f17e0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.010748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 376/749] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:36.012058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e51f38-677f-436d-959d-8e11316a2c79 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.012353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e51f38-677f-436d-959d-8e11316a2c79 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.012630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e51f38-677f-436d-959d-8e11316a2c79 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.014554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 377/750] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:36.015550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e51f38-677f-436d-959d-8e11316a2c79 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.020552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:36.110610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:36.116353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660841cd-820b-4b4b-8027-3931488f17e0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:36.133127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e51f38-677f-436d-959d-8e11316a2c79 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:36.161850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f0d4a-3847-4b66-908b-391c7ef9ef09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:36.163015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f0d4a-3847-4b66-908b-391c7ef9ef09 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.163455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f0d4a-3847-4b66-908b-391c7ef9ef09 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.164608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f0d4a-3847-4b66-908b-391c7ef9ef09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.170529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca63e5-03f6-42f4-a6e3-c668e6da2f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:36.171188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca63e5-03f6-42f4-a6e3-c668e6da2f92 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.171474 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca63e5-03f6-42f4-a6e3-c668e6da2f92 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.171755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca63e5-03f6-42f4-a6e3-c668e6da2f92 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.172964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca63e5-03f6-42f4-a6e3-c668e6da2f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:36.173282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca63e5-03f6-42f4-a6e3-c668e6da2f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:36.175076 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca63e5-03f6-42f4-a6e3-c668e6da2f92 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:36.176309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f0d4a-3847-4b66-908b-391c7ef9ef09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:36.177912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f0d4a-3847-4b66-908b-391c7ef9ef09 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:36.188860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 378/751] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:36.190748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca63e5-03f6-42f4-a6e3-c668e6da2f92 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-422f0d4a-3847-4b66-908b-391c7ef9ef09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:36.197825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:36.198835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:36.199739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:36.199739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:36.199739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:36.199739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:36.203685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 374/752] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:36.204728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc6467-9e4c-4af9-9f18-aea078d14848 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.205015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc6467-9e4c-4af9-9f18-aea078d14848 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.205294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc6467-9e4c-4af9-9f18-aea078d14848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.223606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-91cc6467-9e4c-4af9-9f18-aea078d14848 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:36.224738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-91cc6467-9e4c-4af9-9f18-aea078d14848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:36.291496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:36.303311 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca63e5-03f6-42f4-a6e3-c668e6da2f92 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:36.314343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 375/753] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:36.314343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc6467-9e4c-4af9-9f18-aea078d14848 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.348050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417389dd-0ac3-45ab-977d-d317ba5c20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:36.348852 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417389dd-0ac3-45ab-977d-d317ba5c20df None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.349131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417389dd-0ac3-45ab-977d-d317ba5c20df None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.349408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417389dd-0ac3-45ab-977d-d317ba5c20df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.357568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417389dd-0ac3-45ab-977d-d317ba5c20df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:36.359588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417389dd-0ac3-45ab-977d-d317ba5c20df None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:36.363810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-417389dd-0ac3-45ab-977d-d317ba5c20df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:36.377878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:36.378950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 379/754] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:36.379917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417389dd-0ac3-45ab-977d-d317ba5c20df None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.431227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc6467-9e4c-4af9-9f18-aea078d14848 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:36.471592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a2da0-809d-4d27-84b1-41a48726ade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:36.472730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a2da0-809d-4d27-84b1-41a48726ade8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.473219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a2da0-809d-4d27-84b1-41a48726ade8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.473734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a2da0-809d-4d27-84b1-41a48726ade8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.482416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a2da0-809d-4d27-84b1-41a48726ade8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:36.484054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a2da0-809d-4d27-84b1-41a48726ade8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:36.485894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417389dd-0ac3-45ab-977d-d317ba5c20df None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-725a2da0-809d-4d27-84b1-41a48726ade8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:36.498818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:36.499957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:36.501104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:36.501104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:36.501104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:36.501104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:36.501104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:36.501104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:36.501104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:36.501104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:36.508078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 376/755] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:36.509073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a2da0-809d-4d27-84b1-41a48726ade8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.528185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e8c5f-52f0-4144-a02f-72a381a355bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:36.528936 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e8c5f-52f0-4144-a02f-72a381a355bd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.529282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e8c5f-52f0-4144-a02f-72a381a355bd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.529624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e8c5f-52f0-4144-a02f-72a381a355bd None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.530492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e8c5f-52f0-4144-a02f-72a381a355bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:36.530998 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e8c5f-52f0-4144-a02f-72a381a355bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:36.532317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e8c5f-52f0-4144-a02f-72a381a355bd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:36.549866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 380/756] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:36.555088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e8c5f-52f0-4144-a02f-72a381a355bd None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.578365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:36.619611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:36.633411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a2da0-809d-4d27-84b1-41a48726ade8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:36.666869 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e8c5f-52f0-4144-a02f-72a381a355bd None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:36.670469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de216-28b7-4a6d-9f76-c875ae8f5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:36.671284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de216-28b7-4a6d-9f76-c875ae8f5998 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.671569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de216-28b7-4a6d-9f76-c875ae8f5998 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.671847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86de216-28b7-4a6d-9f76-c875ae8f5998 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.672512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de216-28b7-4a6d-9f76-c875ae8f5998 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:36.673918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86de216-28b7-4a6d-9f76-c875ae8f5998 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-d86de216-28b7-4a6d-9f76-c875ae8f5998 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:36.687102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:36.688109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:36.688987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 377/757] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:36.689836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de216-28b7-4a6d-9f76-c875ae8f5998 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.710291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5893d1-ebb7-4dfd-82bc-a76d77b6d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:36.711541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5893d1-ebb7-4dfd-82bc-a76d77b6d90f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.711821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5893d1-ebb7-4dfd-82bc-a76d77b6d90f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.712112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5893d1-ebb7-4dfd-82bc-a76d77b6d90f None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.712960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5893d1-ebb7-4dfd-82bc-a76d77b6d90f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:36.713265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5893d1-ebb7-4dfd-82bc-a76d77b6d90f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:36.714812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5893d1-ebb7-4dfd-82bc-a76d77b6d90f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:36.736074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 381/758] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:36.736872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5893d1-ebb7-4dfd-82bc-a76d77b6d90f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.820133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86de216-28b7-4a6d-9f76-c875ae8f5998 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:36.836312 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:36.856488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5893d1-ebb7-4dfd-82bc-a76d77b6d90f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:36.861690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aaf17-d167-491b-a8e6-33d401a701da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:36.862369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aaf17-d167-491b-a8e6-33d401a701da None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.862656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aaf17-d167-491b-a8e6-33d401a701da None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.862933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aaf17-d167-491b-a8e6-33d401a701da None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.863770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aaf17-d167-491b-a8e6-33d401a701da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:36.864078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aaf17-d167-491b-a8e6-33d401a701da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:36.865515 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aaf17-d167-491b-a8e6-33d401a701da None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:36.883524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 378/759] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:36.883524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aaf17-d167-491b-a8e6-33d401a701da None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.884904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:36.904247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3bb2-8f72-4973-ad6e-a74d884204dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:36.905130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3bb2-8f72-4973-ad6e-a74d884204dc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:36.905489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3bb2-8f72-4973-ad6e-a74d884204dc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:36.905845 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3bb2-8f72-4973-ad6e-a74d884204dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:36.912919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee3bb2-8f72-4973-ad6e-a74d884204dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:36.915787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee3bb2-8f72-4973-ad6e-a74d884204dc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-8eee3bb2-8f72-4973-ad6e-a74d884204dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:36.931072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:36.932008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:36.932902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:36.932902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:36.932902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:36.932902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:36.932902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:36.932902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:36.932902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:36.932902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:36.932902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 382/760] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:36.934002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3bb2-8f72-4973-ad6e-a74d884204dc None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:36.997543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aaf17-d167-491b-a8e6-33d401a701da None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:37.036648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e066-75db-4f78-adc8-becc1a262e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:37.037587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e066-75db-4f78-adc8-becc1a262e77 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.038064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e066-75db-4f78-adc8-becc1a262e77 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.038508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8e066-75db-4f78-adc8-becc1a262e77 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.039861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8e066-75db-4f78-adc8-becc1a262e77 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:37.040339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8e066-75db-4f78-adc8-becc1a262e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:37.041707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8e066-75db-4f78-adc8-becc1a262e77 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:37.043997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3bb2-8f72-4973-ad6e-a74d884204dc None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:37.050551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 379/761] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:37.050551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e066-75db-4f78-adc8-becc1a262e77 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:37.086090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587c7b0-37be-4c98-bb83-ae98537f8b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:37.086916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587c7b0-37be-4c98-bb83-ae98537f8b08 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.087199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587c7b0-37be-4c98-bb83-ae98537f8b08 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.087475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587c7b0-37be-4c98-bb83-ae98537f8b08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.090091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:37.136518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:37.155988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8e066-75db-4f78-adc8-becc1a262e77 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:37.159308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587c7b0-37be-4c98-bb83-ae98537f8b08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:37.160767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587c7b0-37be-4c98-bb83-ae98537f8b08 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:37.190598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a263f03-a34e-4141-aafa-32208ec7a127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:37.191474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a263f03-a34e-4141-aafa-32208ec7a127 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.191750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a263f03-a34e-4141-aafa-32208ec7a127 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.192022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a263f03-a34e-4141-aafa-32208ec7a127 None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/0d639e845cfa4f10b8e86cd237664c9b/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.193996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a263f03-a34e-4141-aafa-32208ec7a127 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=0d639e845cfa4f10b8e86cd237664c9b, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:37.195486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a263f03-a34e-4141-aafa-32208ec7a127 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:37.209066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 380/762] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:37:37 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/0d639e845cfa4f10b8e86cd237664c9b/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:37:37.209876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a263f03-a34e-4141-aafa-32208ec7a127 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:37.287280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 383/763] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:37:37.287280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587c7b0-37be-4c98-bb83-ae98537f8b08 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:37.326866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:37.331684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a263f03-a34e-4141-aafa-32208ec7a127 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:37.378908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb62221-930d-46ec-9737-01ab23bc80ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:37.379402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:37.379605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb62221-930d-46ec-9737-01ab23bc80ef None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.379903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb62221-930d-46ec-9737-01ab23bc80ef None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.380188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb62221-930d-46ec-9737-01ab23bc80ef None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.380989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb62221-930d-46ec-9737-01ab23bc80ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:37.381304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb62221-930d-46ec-9737-01ab23bc80ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:37.384032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb62221-930d-46ec-9737-01ab23bc80ef None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:37.397570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 381/764] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:37.399233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e8ea7-99bb-4554-9083-9f27c5aa3800 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.399533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e8ea7-99bb-4554-9083-9f27c5aa3800 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.399813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e8ea7-99bb-4554-9083-9f27c5aa3800 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.401217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 382/765] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:37.405384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e8ea7-99bb-4554-9083-9f27c5aa3800 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:37.409549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587c7b0-37be-4c98-bb83-ae98537f8b08 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:37.451910 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f7ea9-4d6f-4c49-8e83-96bf8790e36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:37.452857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f7ea9-4d6f-4c49-8e83-96bf8790e36d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.453165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f7ea9-4d6f-4c49-8e83-96bf8790e36d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.453576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f7ea9-4d6f-4c49-8e83-96bf8790e36d None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.454474 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f7ea9-4d6f-4c49-8e83-96bf8790e36d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:37.454789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f7ea9-4d6f-4c49-8e83-96bf8790e36d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:37.456753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f7ea9-4d6f-4c49-8e83-96bf8790e36d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:37.468006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 384/766] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 23 10:37:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:37.468006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f7ea9-4d6f-4c49-8e83-96bf8790e36d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:37.514920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e8ea7-99bb-4554-9083-9f27c5aa3800 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:37.557946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45bf7e-517f-473c-b926-2d713422e5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:37.558959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45bf7e-517f-473c-b926-2d713422e5dd None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.559070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45bf7e-517f-473c-b926-2d713422e5dd None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.559334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45bf7e-517f-473c-b926-2d713422e5dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.570815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45bf7e-517f-473c-b926-2d713422e5dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:37.572294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45bf7e-517f-473c-b926-2d713422e5dd None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:37.586118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f7ea9-4d6f-4c49-8e83-96bf8790e36d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-aa45bf7e-517f-473c-b926-2d713422e5dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:37.589732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:37.590659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:37.591651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:37.591651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:37.591651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:37.591651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:37.595592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 383/767] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:37.596896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080ccd6-4c08-4be4-8fc6-2744db297c40 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.597185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080ccd6-4c08-4be4-8fc6-2744db297c40 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.597472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080ccd6-4c08-4be4-8fc6-2744db297c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.615165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c080ccd6-4c08-4be4-8fc6-2744db297c40 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:37.616370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c080ccd6-4c08-4be4-8fc6-2744db297c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:37.619730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:37.626273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2024-3d3a-41da-bb1e-df36a92083d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:37.627575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2024-3d3a-41da-bb1e-df36a92083d9 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.627957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2024-3d3a-41da-bb1e-df36a92083d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.628281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a2024-3d3a-41da-bb1e-df36a92083d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.629816 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2024-3d3a-41da-bb1e-df36a92083d9 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=cbf19adc48f0439b9cdcb1aaedd58a01) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:37.630216 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2024-3d3a-41da-bb1e-df36a92083d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:37.632124 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a2024-3d3a-41da-bb1e-df36a92083d9 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:37.646360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 385/768] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:37 2022] GET /identity/v3/role_assignments?user.id=cbf19adc48f0439b9cdcb1aaedd58a01&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:37.646360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2024-3d3a-41da-bb1e-df36a92083d9 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:37.655561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:37.726715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 384/769] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:37.727677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080ccd6-4c08-4be4-8fc6-2744db297c40 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:37.796669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a2024-3d3a-41da-bb1e-df36a92083d9 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:37.842990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59625d-aa22-4d27-ae74-dcb8ce3500d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:37.843770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59625d-aa22-4d27-ae74-dcb8ce3500d8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.844126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59625d-aa22-4d27-ae74-dcb8ce3500d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.844480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59625d-aa22-4d27-ae74-dcb8ce3500d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.845292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59625d-aa22-4d27-ae74-dcb8ce3500d8 None admin] RBAC: Adding query filter params (interface=public, service_id=00d4539a161a49f3a0834ca0db441d5f, region_id=RegionOne) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:37.845615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59625d-aa22-4d27-ae74-dcb8ce3500d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:37.847027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59625d-aa22-4d27-ae74-dcb8ce3500d8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:37.852327 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080ccd6-4c08-4be4-8fc6-2744db297c40 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:37.860902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 386/770] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 23 10:37:37 2022] GET /identity/v3/endpoints?service_id=00d4539a161a49f3a0834ca0db441d5f&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:37.861972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59625d-aa22-4d27-ae74-dcb8ce3500d8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:37.901594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0615424-9d59-4afd-bb79-77adc13b5f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:37.902409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615424-9d59-4afd-bb79-77adc13b5f96 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:37.902740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615424-9d59-4afd-bb79-77adc13b5f96 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:37.903107 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615424-9d59-4afd-bb79-77adc13b5f96 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:37.904041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0615424-9d59-4afd-bb79-77adc13b5f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:37.904352 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0615424-9d59-4afd-bb79-77adc13b5f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:37.905865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0615424-9d59-4afd-bb79-77adc13b5f96 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:37.916282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:37.924790 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 385/771] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:37.925866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0615424-9d59-4afd-bb79-77adc13b5f96 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:37.966369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:38.010899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59625d-aa22-4d27-ae74-dcb8ce3500d8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:38.042148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0615424-9d59-4afd-bb79-77adc13b5f96 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:38.052992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0791ec-bab9-4f2e-8cc2-c942f6fd28d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:38.054114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0791ec-bab9-4f2e-8cc2-c942f6fd28d8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:38.054931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0791ec-bab9-4f2e-8cc2-c942f6fd28d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:38.055488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0791ec-bab9-4f2e-8cc2-c942f6fd28d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:38.056456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0791ec-bab9-4f2e-8cc2-c942f6fd28d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:38.058151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0791ec-bab9-4f2e-8cc2-c942f6fd28d8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-bf0791ec-bab9-4f2e-8cc2-c942f6fd28d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:38.071597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:38.072615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:37:38.073471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:38.076447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 387/772] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:37 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:38.077536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0791ec-bab9-4f2e-8cc2-c942f6fd28d8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:38.083389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d48b-293a-48f0-9196-9dd823ce30da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:38.084650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d48b-293a-48f0-9196-9dd823ce30da None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:38.086768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d48b-293a-48f0-9196-9dd823ce30da None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:38.087269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d48b-293a-48f0-9196-9dd823ce30da None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:38.088179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d48b-293a-48f0-9196-9dd823ce30da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:38.089981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d48b-293a-48f0-9196-9dd823ce30da None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:38.098289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 386/773] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 23 10:37:37 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:38.099734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d48b-293a-48f0-9196-9dd823ce30da None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:38.233010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0791ec-bab9-4f2e-8cc2-c942f6fd28d8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:38.258709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:38.280146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135bb2f-5ce8-4c94-8538-63beaf97fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:38.281382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135bb2f-5ce8-4c94-8538-63beaf97fe31 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:38.281822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135bb2f-5ce8-4c94-8538-63beaf97fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:38.282198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135bb2f-5ce8-4c94-8538-63beaf97fe31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:38.284563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:38.292498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135bb2f-5ce8-4c94-8538-63beaf97fe31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:38.294766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135bb2f-5ce8-4c94-8538-63beaf97fe31 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-8135bb2f-5ce8-4c94-8538-63beaf97fe31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:38.311575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:38.312509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:38.313844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:38.313844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:38.313844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:38.313844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:38.313844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:38.313844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:38.313844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:38.313844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:38.316736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 388/774] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:38.327667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135bb2f-5ce8-4c94-8538-63beaf97fe31 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:38.352473 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d48b-293a-48f0-9196-9dd823ce30da None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:38.396498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7ef7-6497-44d5-b04c-561bcc230788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:38.396785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7ef7-6497-44d5-b04c-561bcc230788 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:38.397165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7ef7-6497-44d5-b04c-561bcc230788 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:38.397322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7ef7-6497-44d5-b04c-561bcc230788 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:38.398346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a7ef7-6497-44d5-b04c-561bcc230788 None admin] RBAC: Adding query filter params (name=network) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:38.398756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a7ef7-6497-44d5-b04c-561bcc230788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:38.400001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a7ef7-6497-44d5-b04c-561bcc230788 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:38.407773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 387/775] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:37:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:38.412031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7ef7-6497-44d5-b04c-561bcc230788 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:38.503268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135bb2f-5ce8-4c94-8538-63beaf97fe31 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:38.555059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d39644-15cd-4183-b415-2bc2e07421a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:38.555719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d39644-15cd-4183-b415-2bc2e07421a7 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:38.556001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d39644-15cd-4183-b415-2bc2e07421a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:38.556278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d39644-15cd-4183-b415-2bc2e07421a7 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:38.557074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d39644-15cd-4183-b415-2bc2e07421a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:38.557384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d39644-15cd-4183-b415-2bc2e07421a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:38.560540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d39644-15cd-4183-b415-2bc2e07421a7 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:38.583349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 389/776] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:38.593526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d39644-15cd-4183-b415-2bc2e07421a7 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:38.596511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7ef7-6497-44d5-b04c-561bcc230788 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:38.653852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:38.670667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc707b-bfa0-4807-bd73-66095ca12baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:38.671336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc707b-bfa0-4807-bd73-66095ca12baf None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:38.671618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc707b-bfa0-4807-bd73-66095ca12baf None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:38.671895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc707b-bfa0-4807-bd73-66095ca12baf None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:38.672603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc707b-bfa0-4807-bd73-66095ca12baf None admin] RBAC: Adding query filter params (type=network) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:38.672910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc707b-bfa0-4807-bd73-66095ca12baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:38.674293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc707b-bfa0-4807-bd73-66095ca12baf None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:38.686112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 388/777] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:37:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:38.692376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc707b-bfa0-4807-bd73-66095ca12baf None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:38.717276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:38.814026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc707b-bfa0-4807-bd73-66095ca12baf None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:38.844689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d39644-15cd-4183-b415-2bc2e07421a7 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:38.858125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90271fde-a956-4e9f-8d05-32e8945ec765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:38.858874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90271fde-a956-4e9f-8d05-32e8945ec765 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:38.859155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90271fde-a956-4e9f-8d05-32e8945ec765 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:38.859432 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90271fde-a956-4e9f-8d05-32e8945ec765 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:38.860346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90271fde-a956-4e9f-8d05-32e8945ec765 None admin] RBAC: Adding query filter params (interface=public, service_id=5f2bd00989704d97b97901e2f526048f, region_id=RegionOne) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:38.860658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90271fde-a956-4e9f-8d05-32e8945ec765 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:38.862072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90271fde-a956-4e9f-8d05-32e8945ec765 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:38.871806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 389/778] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 23 10:37:38 2022] GET /identity/v3/endpoints?service_id=5f2bd00989704d97b97901e2f526048f&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:38.877265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90271fde-a956-4e9f-8d05-32e8945ec765 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:38.951314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:38.952049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b1696-b2d6-48d6-a988-41d72d7dfc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:38.952812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1696-b2d6-48d6-a988-41d72d7dfc13 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:38.953266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1696-b2d6-48d6-a988-41d72d7dfc13 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:38.953641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b1696-b2d6-48d6-a988-41d72d7dfc13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:38.954520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b1696-b2d6-48d6-a988-41d72d7dfc13 None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=8dcf5fbe26e44d858d5a2f708cd28c63) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:38.954839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b1696-b2d6-48d6-a988-41d72d7dfc13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:38.956301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b1696-b2d6-48d6-a988-41d72d7dfc13 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:38.971102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 390/779] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:38 2022] GET /identity/v3/role_assignments?user.id=8dcf5fbe26e44d858d5a2f708cd28c63&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 259 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:39.003522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90271fde-a956-4e9f-8d05-32e8945ec765 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:39.049759 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16aa3c-9d40-4468-bee5-952c416701d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:39.050484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16aa3c-9d40-4468-bee5-952c416701d1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:39.050771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16aa3c-9d40-4468-bee5-952c416701d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:39.051046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16aa3c-9d40-4468-bee5-952c416701d1 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:39.051735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16aa3c-9d40-4468-bee5-952c416701d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:39.053108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16aa3c-9d40-4468-bee5-952c416701d1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:39.060261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 390/780] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 23 10:37:38 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:39.473198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7d1a-b980-4f45-9ccc-17ab03a9d0d3 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:39.473719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7d1a-b980-4f45-9ccc-17ab03a9d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:39.473798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7d1a-b980-4f45-9ccc-17ab03a9d0d3 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:39.475398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 391/781] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:39.482878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817fa4e-a81a-4fa2-9c66-8d4b99600e1e None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:39.483326 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817fa4e-a81a-4fa2-9c66-8d4b99600e1e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:39.483507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817fa4e-a81a-4fa2-9c66-8d4b99600e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:39.511443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d817fa4e-a81a-4fa2-9c66-8d4b99600e1e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:39.512665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d817fa4e-a81a-4fa2-9c66-8d4b99600e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:39.608437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 391/782] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:39.658022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7d1a-b980-4f45-9ccc-17ab03a9d0d3 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:39.795094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7d1a-b980-4f45-9ccc-17ab03a9d0d3 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:39.819381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:39.843205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e7036-169a-49de-915e-3f2f267fd29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:39.844409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7036-169a-49de-915e-3f2f267fd29c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:39.844941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7036-169a-49de-915e-3f2f267fd29c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:39.845422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e7036-169a-49de-915e-3f2f267fd29c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:39.866416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e7036-169a-49de-915e-3f2f267fd29c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-368e7036-169a-49de-915e-3f2f267fd29c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:39.875406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:39.876376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:39.877259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:39.879791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 392/783] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:39.887204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817fa4e-a81a-4fa2-9c66-8d4b99600e1e None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:39.972155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:40.004769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6164850-1386-409b-a4c5-b82c4af60073 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:40.005463 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6164850-1386-409b-a4c5-b82c4af60073 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:40.005953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6164850-1386-409b-a4c5-b82c4af60073 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:40.008388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 393/784] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:40.017229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a3a4d-e44e-46ae-941d-385a6772a1b3 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:40.017799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a3a4d-e44e-46ae-941d-385a6772a1b3 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:40.018302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a3a4d-e44e-46ae-941d-385a6772a1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:40.029015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817fa4e-a81a-4fa2-9c66-8d4b99600e1e None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:40.055514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-1f6a3a4d-e44e-46ae-941d-385a6772a1b3 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:40.057060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-1f6a3a4d-e44e-46ae-941d-385a6772a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:40.076083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fd6d6-ffdb-4eb3-baf5-533d00968a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:40.076872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fd6d6-ffdb-4eb3-baf5-533d00968a9b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:40.077164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fd6d6-ffdb-4eb3-baf5-533d00968a9b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:40.077446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fd6d6-ffdb-4eb3-baf5-533d00968a9b None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:40.078222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fd6d6-ffdb-4eb3-baf5-533d00968a9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:40.078539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fd6d6-ffdb-4eb3-baf5-533d00968a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:40.079915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fd6d6-ffdb-4eb3-baf5-533d00968a9b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:40.089258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 392/785] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:40.095843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fd6d6-ffdb-4eb3-baf5-533d00968a9b None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:40.186430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 394/786] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:37:40.208946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fd6d6-ffdb-4eb3-baf5-533d00968a9b None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:40.218526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a3a4d-e44e-46ae-941d-385a6772a1b3 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:40.223772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:40.247324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3e413-b818-4305-a30c-121fb58bd3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:40.248453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3e413-b818-4305-a30c-121fb58bd3f7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:40.248917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3e413-b818-4305-a30c-121fb58bd3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:40.249365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3e413-b818-4305-a30c-121fb58bd3f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:40.261349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3e413-b818-4305-a30c-121fb58bd3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:40.263131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3e413-b818-4305-a30c-121fb58bd3f7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-ffb3e413-b818-4305-a30c-121fb58bd3f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:40.282486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:40.283646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:40.284758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:40.284758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:40.284758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:40.284758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:40.287846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 393/787] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:40.292644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3e413-b818-4305-a30c-121fb58bd3f7 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:40.460161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a3a4d-e44e-46ae-941d-385a6772a1b3 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:40.482684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:40.505602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3e413-b818-4305-a30c-121fb58bd3f7 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:40.544816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd080686-339d-4012-97e3-5d4f1d67d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:40.545493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd080686-339d-4012-97e3-5d4f1d67d26e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:40.545822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd080686-339d-4012-97e3-5d4f1d67d26e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:40.546113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd080686-339d-4012-97e3-5d4f1d67d26e None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:40.546880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd080686-339d-4012-97e3-5d4f1d67d26e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:40.547196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd080686-339d-4012-97e3-5d4f1d67d26e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:40.548593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd080686-339d-4012-97e3-5d4f1d67d26e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:40.562462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 394/788] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:40.569316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd080686-339d-4012-97e3-5d4f1d67d26e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:40.579942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039d281-331d-4f0b-b59a-53d02df6c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:40.580740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d281-331d-4f0b-b59a-53d02df6c1fc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:40.581020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d281-331d-4f0b-b59a-53d02df6c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:40.581298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039d281-331d-4f0b-b59a-53d02df6c1fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:40.598512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039d281-331d-4f0b-b59a-53d02df6c1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-d039d281-331d-4f0b-b59a-53d02df6c1fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:40.614476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:40.615517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:40.616413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:40.617874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 395/789] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:40.624764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039d281-331d-4f0b-b59a-53d02df6c1fc None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:40.626119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:40.741477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd080686-339d-4012-97e3-5d4f1d67d26e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:40.782847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f04d4-9153-439a-b19f-3a4b665ebea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:40.783698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f04d4-9153-439a-b19f-3a4b665ebea0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:40.783985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f04d4-9153-439a-b19f-3a4b665ebea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:40.784261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f04d4-9153-439a-b19f-3a4b665ebea0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:40.802880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f04d4-9153-439a-b19f-3a4b665ebea0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:40.804932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f04d4-9153-439a-b19f-3a4b665ebea0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:40.837621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039d281-331d-4f0b-b59a-53d02df6c1fc None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-958f04d4-9153-439a-b19f-3a4b665ebea0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:40.838761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:40.839785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:40.840784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 395/790] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 23 10:37:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:40.855325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f04d4-9153-439a-b19f-3a4b665ebea0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:40.888118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f37169-2a9b-437a-a24f-77d4e0f81860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:40.888958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f37169-2a9b-437a-a24f-77d4e0f81860 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:40.889249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f37169-2a9b-437a-a24f-77d4e0f81860 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:40.889532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f37169-2a9b-437a-a24f-77d4e0f81860 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:40.890375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f37169-2a9b-437a-a24f-77d4e0f81860 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:40.890690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f37169-2a9b-437a-a24f-77d4e0f81860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:40.894276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f37169-2a9b-437a-a24f-77d4e0f81860 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:40.914634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 396/791] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:40.919323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f37169-2a9b-437a-a24f-77d4e0f81860 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:40.957654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:40.983727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:41.000936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f04d4-9153-439a-b19f-3a4b665ebea0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:41.037340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b647a28-9439-492e-a5d1-9878841a7f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:41.038113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b647a28-9439-492e-a5d1-9878841a7f97 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.038591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b647a28-9439-492e-a5d1-9878841a7f97 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.039485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b647a28-9439-492e-a5d1-9878841a7f97 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.040404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b647a28-9439-492e-a5d1-9878841a7f97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:41.040786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b647a28-9439-492e-a5d1-9878841a7f97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:41.042337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b647a28-9439-492e-a5d1-9878841a7f97 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:41.043749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f37169-2a9b-437a-a24f-77d4e0f81860 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:41.061172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 396/792] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 23 10:37:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:41.062646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44d3a8-e899-4945-9685-56d45d00a2f0 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.063024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44d3a8-e899-4945-9685-56d45d00a2f0 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.063375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44d3a8-e899-4945-9685-56d45d00a2f0 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.064952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 397/793] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:41.066615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44d3a8-e899-4945-9685-56d45d00a2f0 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:41.087170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0860197-5b22-485c-860a-eb49bd7778ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:41.087979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0860197-5b22-485c-860a-eb49bd7778ae None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.088266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0860197-5b22-485c-860a-eb49bd7778ae None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.088549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0860197-5b22-485c-860a-eb49bd7778ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.102085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0860197-5b22-485c-860a-eb49bd7778ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:41.104068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0860197-5b22-485c-860a-eb49bd7778ae None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-e0860197-5b22-485c-860a-eb49bd7778ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:41.125010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:41.127270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:41.129410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:41.129410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:41.129410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:41.129410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:41.129410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 397/794] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:41.129410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805cd2b-085d-480f-aa89-e2f7807c266f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.129410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805cd2b-085d-480f-aa89-e2f7807c266f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.129410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805cd2b-085d-480f-aa89-e2f7807c266f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.152419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d805cd2b-085d-480f-aa89-e2f7807c266f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:41.153900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d805cd2b-085d-480f-aa89-e2f7807c266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:41.185342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44d3a8-e899-4945-9685-56d45d00a2f0 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:41.222787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd61abc-8341-44e5-8c8b-3f885c3f18c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:41.223315 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd61abc-8341-44e5-8c8b-3f885c3f18c9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.223603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd61abc-8341-44e5-8c8b-3f885c3f18c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.223885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd61abc-8341-44e5-8c8b-3f885c3f18c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.242514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 398/795] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:41.243075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:41.244901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805cd2b-085d-480f-aa89-e2f7807c266f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:41.269907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:41.298566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd61abc-8341-44e5-8c8b-3f885c3f18c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:41.300111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd61abc-8341-44e5-8c8b-3f885c3f18c9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:41.375608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805cd2b-085d-480f-aa89-e2f7807c266f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:41.414615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 398/796] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:37:41.415552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd61abc-8341-44e5-8c8b-3f885c3f18c9 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:41.415803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51531002-1338-4009-8084-5702f4a67241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:41.416637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51531002-1338-4009-8084-5702f4a67241 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.417070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51531002-1338-4009-8084-5702f4a67241 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.417498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51531002-1338-4009-8084-5702f4a67241 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.418689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51531002-1338-4009-8084-5702f4a67241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:41.419267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51531002-1338-4009-8084-5702f4a67241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:41.420806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51531002-1338-4009-8084-5702f4a67241 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:41.434249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 399/797] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:41.435736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51531002-1338-4009-8084-5702f4a67241 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:41.464019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:41.520447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:41.533483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd61abc-8341-44e5-8c8b-3f885c3f18c9 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:41.556448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51531002-1338-4009-8084-5702f4a67241 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:41.579533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd17ec-d081-45f5-aa3e-a55c93c69438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:41.580422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd17ec-d081-45f5-aa3e-a55c93c69438 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.580700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd17ec-d081-45f5-aa3e-a55c93c69438 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.581001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd17ec-d081-45f5-aa3e-a55c93c69438 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.581635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd17ec-d081-45f5-aa3e-a55c93c69438 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:41.583267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd17ec-d081-45f5-aa3e-a55c93c69438 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:41.590622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5ce9-599b-49dc-814c-06aa96256a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:41.591408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5ce9-599b-49dc-814c-06aa96256a31 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.591693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5ce9-599b-49dc-814c-06aa96256a31 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.592048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5ce9-599b-49dc-814c-06aa96256a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-86fd17ec-d081-45f5-aa3e-a55c93c69438 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:41.596209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:41.597158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:41.603586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 399/798] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jun 23 10:37:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:41.604453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd17ec-d081-45f5-aa3e-a55c93c69438 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:41.610085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b5ce9-599b-49dc-814c-06aa96256a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:41.611593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b5ce9-599b-49dc-814c-06aa96256a31 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-1d5b5ce9-599b-49dc-814c-06aa96256a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:41.635948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:41.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:41.638470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:41.638470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:41.638470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:41.638470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:41.638470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 400/799] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:41.639036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebaa2c-ef00-4199-b8e1-6d2cf8348ac9 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.639379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebaa2c-ef00-4199-b8e1-6d2cf8348ac9 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.639607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebaa2c-ef00-4199-b8e1-6d2cf8348ac9 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.645318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 401/800] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:41.645318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebaa2c-ef00-4199-b8e1-6d2cf8348ac9 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:41.714635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd17ec-d081-45f5-aa3e-a55c93c69438 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:41.721551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:41.749470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be227ae-990a-45af-affc-23e8342b717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:41.750256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be227ae-990a-45af-affc-23e8342b717e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.750579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be227ae-990a-45af-affc-23e8342b717e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.750866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be227ae-990a-45af-affc-23e8342b717e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.751069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebaa2c-ef00-4199-b8e1-6d2cf8348ac9 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:41.758656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be227ae-990a-45af-affc-23e8342b717e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:41.760104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be227ae-990a-45af-affc-23e8342b717e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:41.774427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-8be227ae-990a-45af-affc-23e8342b717e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:41.774564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:41.775658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 400/801] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:41.776632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be227ae-990a-45af-affc-23e8342b717e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:41.790152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a6b64-5a9e-4478-8b43-05824f3407d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:41.790850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a6b64-5a9e-4478-8b43-05824f3407d1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.791133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a6b64-5a9e-4478-8b43-05824f3407d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.791406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a6b64-5a9e-4478-8b43-05824f3407d1 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.792111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a6b64-5a9e-4478-8b43-05824f3407d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:41.792417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a6b64-5a9e-4478-8b43-05824f3407d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:41.793817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a6b64-5a9e-4478-8b43-05824f3407d1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:41.798197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 402/802] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 23 10:37:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:41.799546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232b58c-4939-4a25-ae03-cd910606167e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.799832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232b58c-4939-4a25-ae03-cd910606167e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.800115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232b58c-4939-4a25-ae03-cd910606167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.816246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2232b58c-4939-4a25-ae03-cd910606167e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:41.817420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2232b58c-4939-4a25-ae03-cd910606167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:41.884871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 403/803] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:41.885773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be227ae-990a-45af-affc-23e8342b717e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:41.886824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5f13-9b56-41e5-b8d2-3a54ff840744 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.887194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5f13-9b56-41e5-b8d2-3a54ff840744 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.887473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5f13-9b56-41e5-b8d2-3a54ff840744 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.888757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 404/804] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:41.889444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5f13-9b56-41e5-b8d2-3a54ff840744 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:41.926639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe140-e6d5-433d-b8c2-4fa189e7c5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:41.927309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe140-e6d5-433d-b8c2-4fa189e7c5fe None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:41.927595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe140-e6d5-433d-b8c2-4fa189e7c5fe None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:41.927877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fe140-e6d5-433d-b8c2-4fa189e7c5fe None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:41.928603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fe140-e6d5-433d-b8c2-4fa189e7c5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:41.928916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fe140-e6d5-433d-b8c2-4fa189e7c5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:41.930977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fe140-e6d5-433d-b8c2-4fa189e7c5fe None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:41.943113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 401/805] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:41.943932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe140-e6d5-433d-b8c2-4fa189e7c5fe None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:41.977028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:42.012908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5f13-9b56-41e5-b8d2-3a54ff840744 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.031457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:42.050392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b250f-ed18-421e-a035-eeca849e164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.051072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b250f-ed18-421e-a035-eeca849e164f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.051348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b250f-ed18-421e-a035-eeca849e164f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.051633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b250f-ed18-421e-a035-eeca849e164f None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.052477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b250f-ed18-421e-a035-eeca849e164f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:42.052782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b250f-ed18-421e-a035-eeca849e164f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.054266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b250f-ed18-421e-a035-eeca849e164f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.058405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fe140-e6d5-433d-b8c2-4fa189e7c5fe None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.075625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 405/806] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 23 10:37:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:42.076988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6611be-8abf-4de4-9df9-e6614d059589 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.077287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6611be-8abf-4de4-9df9-e6614d059589 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.077567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6611be-8abf-4de4-9df9-e6614d059589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.094521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-3c6611be-8abf-4de4-9df9-e6614d059589 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:42.095733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3c6611be-8abf-4de4-9df9-e6614d059589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:42.100185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884e11d-aec2-4326-83e4-51a05079cf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.100842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884e11d-aec2-4326-83e4-51a05079cf99 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.101160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884e11d-aec2-4326-83e4-51a05079cf99 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.101436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884e11d-aec2-4326-83e4-51a05079cf99 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.102238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884e11d-aec2-4326-83e4-51a05079cf99 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:42.102576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884e11d-aec2-4326-83e4-51a05079cf99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.103973 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884e11d-aec2-4326-83e4-51a05079cf99 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.110833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 402/807] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jun 23 10:37:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:42.111532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884e11d-aec2-4326-83e4-51a05079cf99 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.210933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:42.221638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884e11d-aec2-4326-83e4-51a05079cf99 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.258831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cbfda-0f8c-49ad-b81a-6fcf358b9959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.259622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cbfda-0f8c-49ad-b81a-6fcf358b9959 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.259903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cbfda-0f8c-49ad-b81a-6fcf358b9959 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.260186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cbfda-0f8c-49ad-b81a-6fcf358b9959 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.270537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cbfda-0f8c-49ad-b81a-6fcf358b9959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-952cbfda-0f8c-49ad-b81a-6fcf358b9959 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:42.278691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:42.279867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:42.280751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 403/808] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:42.281453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cbfda-0f8c-49ad-b81a-6fcf358b9959 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.285990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 406/809] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:42.286792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6611be-8abf-4de4-9df9-e6614d059589 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.386724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cbfda-0f8c-49ad-b81a-6fcf358b9959 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.390105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6611be-8abf-4de4-9df9-e6614d059589 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.397210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:42.420672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fff308-0e91-4065-8dea-eb3cb5f3e640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.421453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fff308-0e91-4065-8dea-eb3cb5f3e640 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.421733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fff308-0e91-4065-8dea-eb3cb5f3e640 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.422011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fff308-0e91-4065-8dea-eb3cb5f3e640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.425619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edac5e-212e-4004-8b8c-b7ac237e9bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.426428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edac5e-212e-4004-8b8c-b7ac237e9bb0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.426722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edac5e-212e-4004-8b8c-b7ac237e9bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.427002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edac5e-212e-4004-8b8c-b7ac237e9bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.429238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fff308-0e91-4065-8dea-eb3cb5f3e640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.430985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fff308-0e91-4065-8dea-eb3cb5f3e640 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.437435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edac5e-212e-4004-8b8c-b7ac237e9bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.438929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67edac5e-212e-4004-8b8c-b7ac237e9bb0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-78fff308-0e91-4065-8dea-eb3cb5f3e640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:42.445373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:42.446383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 404/810] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:42.447316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fff308-0e91-4065-8dea-eb3cb5f3e640 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.459225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-67edac5e-212e-4004-8b8c-b7ac237e9bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:42.459710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:42.461648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:42.462606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:42.462606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:42.462606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:42.462606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:42.462606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 407/811] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:42.462606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edac5e-212e-4004-8b8c-b7ac237e9bb0 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.556414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fff308-0e91-4065-8dea-eb3cb5f3e640 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.564067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edac5e-212e-4004-8b8c-b7ac237e9bb0 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.591411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322a0df-2025-411b-80fd-9cd211cb3211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.592059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322a0df-2025-411b-80fd-9cd211cb3211 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.592339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322a0df-2025-411b-80fd-9cd211cb3211 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.592617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322a0df-2025-411b-80fd-9cd211cb3211 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.593345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322a0df-2025-411b-80fd-9cd211cb3211 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.594741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322a0df-2025-411b-80fd-9cd211cb3211 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.598191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68e876-9f3e-4196-9d31-787c97e74a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.598888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68e876-9f3e-4196-9d31-787c97e74a32 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.599214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68e876-9f3e-4196-9d31-787c97e74a32 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.599501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68e876-9f3e-4196-9d31-787c97e74a32 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.600249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68e876-9f3e-4196-9d31-787c97e74a32 None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:42.600622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68e876-9f3e-4196-9d31-787c97e74a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.602018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68e876-9f3e-4196-9d31-787c97e74a32 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.615930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 408/812] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:42.615930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68e876-9f3e-4196-9d31-787c97e74a32 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.618575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 405/813] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 23 10:37:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:42.626115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322a0df-2025-411b-80fd-9cd211cb3211 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.637347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:42.703357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:42.744544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68e876-9f3e-4196-9d31-787c97e74a32 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.750560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322a0df-2025-411b-80fd-9cd211cb3211 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.784545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac3df9-1c68-4138-acba-0ead5868582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.785750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3df9-1c68-4138-acba-0ead5868582e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.785750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3df9-1c68-4138-acba-0ead5868582e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.785925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3df9-1c68-4138-acba-0ead5868582e None admin] PATH_INFO: `/v3/services/network` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.787862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac3df9-1c68-4138-acba-0ead5868582e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.789324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac3df9-1c68-4138-acba-0ead5868582e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.790678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbddf6-88e8-451a-9c7f-ba33e5c05c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.791474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbddf6-88e8-451a-9c7f-ba33e5c05c13 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.791774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbddf6-88e8-451a-9c7f-ba33e5c05c13 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.792349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbddf6-88e8-451a-9c7f-ba33e5c05c13 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.793164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbddf6-88e8-451a-9c7f-ba33e5c05c13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:42.793480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbddf6-88e8-451a-9c7f-ba33e5c05c13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.794985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbddf6-88e8-451a-9c7f-ba33e5c05c13 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-bfac3df9-1c68-4138-acba-0ead5868582e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:42.801346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:42.802385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:42.803259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 409/814] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:42.804059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac3df9-1c68-4138-acba-0ead5868582e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.813222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 406/815] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:42.813662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbddf6-88e8-451a-9c7f-ba33e5c05c13 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.903614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:42.920927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbddf6-88e8-451a-9c7f-ba33e5c05c13 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.922716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac3df9-1c68-4138-acba-0ead5868582e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:42.946291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:42.960216 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b35fed-3e8c-48fe-8690-d4026f62de34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.961689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35fed-3e8c-48fe-8690-d4026f62de34 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.961984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35fed-3e8c-48fe-8690-d4026f62de34 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.962266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35fed-3e8c-48fe-8690-d4026f62de34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.964953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06688b84-4458-4a88-995d-70b7122146b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:42.965943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06688b84-4458-4a88-995d-70b7122146b3 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:42.966232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06688b84-4458-4a88-995d-70b7122146b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:42.966540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06688b84-4458-4a88-995d-70b7122146b3 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:42.967273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06688b84-4458-4a88-995d-70b7122146b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:42.967583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06688b84-4458-4a88-995d-70b7122146b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.968945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06688b84-4458-4a88-995d-70b7122146b3 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.973426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b35fed-3e8c-48fe-8690-d4026f62de34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:42.975158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b35fed-3e8c-48fe-8690-d4026f62de34 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:42.988333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 410/816] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:42.988333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06688b84-4458-4a88-995d-70b7122146b3 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-c7b35fed-3e8c-48fe-8690-d4026f62de34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:42.995624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:42.996719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:42.997858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:42.997858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:42.997858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:42.997858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:42.997858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 407/817] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:43.003377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b35fed-3e8c-48fe-8690-d4026f62de34 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:43.098891 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06688b84-4458-4a88-995d-70b7122146b3 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:43.130178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b35fed-3e8c-48fe-8690-d4026f62de34 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:43.141663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b83124-2834-42cc-94fd-e384e0a0ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:43.142440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b83124-2834-42cc-94fd-e384e0a0ac98 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:43.142728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b83124-2834-42cc-94fd-e384e0a0ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:43.143007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b83124-2834-42cc-94fd-e384e0a0ac98 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:43.143724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b83124-2834-42cc-94fd-e384e0a0ac98 None admin] RBAC: Adding query filter params (name=network) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:43.144035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b83124-2834-42cc-94fd-e384e0a0ac98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:43.145437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b83124-2834-42cc-94fd-e384e0a0ac98 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:43.155919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 411/818] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:43.155919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b83124-2834-42cc-94fd-e384e0a0ac98 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:43.168274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:43.267043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b83124-2834-42cc-94fd-e384e0a0ac98 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:43.283840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895c482-cd6c-4fb6-bd1f-d472c0b5b4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:43.284495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895c482-cd6c-4fb6-bd1f-d472c0b5b4a7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:43.284787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895c482-cd6c-4fb6-bd1f-d472c0b5b4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:43.285069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895c482-cd6c-4fb6-bd1f-d472c0b5b4a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:43.285911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895c482-cd6c-4fb6-bd1f-d472c0b5b4a7 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=0d639e845cfa4f10b8e86cd237664c9b) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:43.286216 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895c482-cd6c-4fb6-bd1f-d472c0b5b4a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:43.287715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895c482-cd6c-4fb6-bd1f-d472c0b5b4a7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:43.294814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 408/819] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:42 2022] GET /identity/v3/role_assignments?user.id=0d639e845cfa4f10b8e86cd237664c9b&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:43.295742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895c482-cd6c-4fb6-bd1f-d472c0b5b4a7 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:43.320584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e279cc-9b2c-433b-9481-61c53174fdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:43.321887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e279cc-9b2c-433b-9481-61c53174fdd9 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:43.322372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e279cc-9b2c-433b-9481-61c53174fdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:43.322857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e279cc-9b2c-433b-9481-61c53174fdd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:43.334040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e279cc-9b2c-433b-9481-61c53174fdd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:43.337258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e279cc-9b2c-433b-9481-61c53174fdd9 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:43.347986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-72e279cc-9b2c-433b-9481-61c53174fdd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:43.361138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:43.362179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:43.363140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:43.363140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:43.363140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:43.363140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:43.363140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:43.363140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:43.363140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:43.363140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:43.368021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 412/820] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:43.369346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e279cc-9b2c-433b-9481-61c53174fdd9 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:43.439378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895c482-cd6c-4fb6-bd1f-d472c0b5b4a7 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:43.474960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:43.488587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282efe1-2a8c-40d4-a8bc-aff1ed7e3786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:43.489938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282efe1-2a8c-40d4-a8bc-aff1ed7e3786 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:43.490397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282efe1-2a8c-40d4-a8bc-aff1ed7e3786 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:43.490859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282efe1-2a8c-40d4-a8bc-aff1ed7e3786 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:43.492096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282efe1-2a8c-40d4-a8bc-aff1ed7e3786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:43.492553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282efe1-2a8c-40d4-a8bc-aff1ed7e3786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:43.494140 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282efe1-2a8c-40d4-a8bc-aff1ed7e3786 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:43.508922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 409/821] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:43.509862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282efe1-2a8c-40d4-a8bc-aff1ed7e3786 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:43.529288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e279cc-9b2c-433b-9481-61c53174fdd9 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:43.577683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018caa73-20ac-4256-8a02-586bd272d483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:43.578371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018caa73-20ac-4256-8a02-586bd272d483 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:43.580859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018caa73-20ac-4256-8a02-586bd272d483 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:43.580859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018caa73-20ac-4256-8a02-586bd272d483 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:43.580859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018caa73-20ac-4256-8a02-586bd272d483 None admin] RBAC: Adding query filter params (type=network) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:43.580859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018caa73-20ac-4256-8a02-586bd272d483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:43.581297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018caa73-20ac-4256-8a02-586bd272d483 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:43.588987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 413/822] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:37:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:43.589921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018caa73-20ac-4256-8a02-586bd272d483 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:43.653567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:43.658405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282efe1-2a8c-40d4-a8bc-aff1ed7e3786 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:43.695809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192effa6-0738-44b4-b50b-73043b8dfdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:43.696497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192effa6-0738-44b4-b50b-73043b8dfdd2 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:43.696782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192effa6-0738-44b4-b50b-73043b8dfdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:43.697058 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192effa6-0738-44b4-b50b-73043b8dfdd2 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:43.697836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192effa6-0738-44b4-b50b-73043b8dfdd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:43.698144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192effa6-0738-44b4-b50b-73043b8dfdd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:43.699752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192effa6-0738-44b4-b50b-73043b8dfdd2 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:43.704099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018caa73-20ac-4256-8a02-586bd272d483 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:43.713043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 410/823] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:43.713870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192effa6-0738-44b4-b50b-73043b8dfdd2 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:43.743753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:43.748181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3c273-e2de-4e8e-b866-4478c949e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:43.749249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3c273-e2de-4e8e-b866-4478c949e9ed None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:43.749647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3c273-e2de-4e8e-b866-4478c949e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:43.749939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3c273-e2de-4e8e-b866-4478c949e9ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:43.759496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3c273-e2de-4e8e-b866-4478c949e9ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:43.760945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3c273-e2de-4e8e-b866-4478c949e9ed None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-7fd3c273-e2de-4e8e-b866-4478c949e9ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:43.776925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:43.777917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:43.778903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:43.782459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 414/824] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:37:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:43.783289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3c273-e2de-4e8e-b866-4478c949e9ed None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:43.819434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192effa6-0738-44b4-b50b-73043b8dfdd2 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:43.857037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523a5f-a53f-4b4e-b9f5-87866e71228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:43.857697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523a5f-a53f-4b4e-b9f5-87866e71228e None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:43.857980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523a5f-a53f-4b4e-b9f5-87866e71228e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:43.858260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c523a5f-a53f-4b4e-b9f5-87866e71228e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:43.859046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c523a5f-a53f-4b4e-b9f5-87866e71228e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:43.860441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c523a5f-a53f-4b4e-b9f5-87866e71228e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:43.887461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 411/825] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 23 10:37:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:43.888404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523a5f-a53f-4b4e-b9f5-87866e71228e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:43.905278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3c273-e2de-4e8e-b866-4478c949e9ed None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:43.931819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:43.961434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908de9a4-6c25-4f7d-8736-6a3112a4ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:43.963439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908de9a4-6c25-4f7d-8736-6a3112a4ad4e None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:43.963989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908de9a4-6c25-4f7d-8736-6a3112a4ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:43.964480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908de9a4-6c25-4f7d-8736-6a3112a4ad4e None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/cbf19adc48f0439b9cdcb1aaedd58a01/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:43.968314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908de9a4-6c25-4f7d-8736-6a3112a4ad4e None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=cbf19adc48f0439b9cdcb1aaedd58a01, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:43.970533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908de9a4-6c25-4f7d-8736-6a3112a4ad4e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:44.010383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 415/826] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:37:43 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/cbf19adc48f0439b9cdcb1aaedd58a01/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:37:44.079847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c523a5f-a53f-4b4e-b9f5-87866e71228e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:44.122584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c99e48-9cc3-46f6-908e-706f00899372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:44.123285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c99e48-9cc3-46f6-908e-706f00899372 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:44.123571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c99e48-9cc3-46f6-908e-706f00899372 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:44.123853 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c99e48-9cc3-46f6-908e-706f00899372 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:44.124726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c99e48-9cc3-46f6-908e-706f00899372 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:44.125040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c99e48-9cc3-46f6-908e-706f00899372 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:44.126632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c99e48-9cc3-46f6-908e-706f00899372 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:44.153647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 412/827] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 23 10:37:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:44.154809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908de9a4-6c25-4f7d-8736-6a3112a4ad4e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:44.218218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:44.278967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908de9a4-6c25-4f7d-8736-6a3112a4ad4e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:44.316910 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51361b84-a195-4640-b955-47ed1a17d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:44.317710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51361b84-a195-4640-b955-47ed1a17d0cb None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:44.317991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51361b84-a195-4640-b955-47ed1a17d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:44.318276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51361b84-a195-4640-b955-47ed1a17d0cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:44.330777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51361b84-a195-4640-b955-47ed1a17d0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:44.332225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51361b84-a195-4640-b955-47ed1a17d0cb None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-51361b84-a195-4640-b955-47ed1a17d0cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:44.350673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:44.352388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:44.353313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:44.353313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:44.353313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:44.353313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:44.353313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 416/828] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:44.360497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c99e48-9cc3-46f6-908e-706f00899372 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:44.451655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:44.490698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c99e48-9cc3-46f6-908e-706f00899372 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:44.533561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea6963-1184-49d3-b1a3-b7968c2e5482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:44.534702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea6963-1184-49d3-b1a3-b7968c2e5482 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:44.534986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea6963-1184-49d3-b1a3-b7968c2e5482 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:44.535260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea6963-1184-49d3-b1a3-b7968c2e5482 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:44.535986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea6963-1184-49d3-b1a3-b7968c2e5482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:44.536290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea6963-1184-49d3-b1a3-b7968c2e5482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:44.537656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea6963-1184-49d3-b1a3-b7968c2e5482 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:44.551248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 413/829] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:44.559448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51361b84-a195-4640-b955-47ed1a17d0cb None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:44.682985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:44.686987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51361b84-a195-4640-b955-47ed1a17d0cb None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:44.722999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f313d7-bfde-4bb9-be1b-c6cd719630c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:44.723776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f313d7-bfde-4bb9-be1b-c6cd719630c0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:44.724057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f313d7-bfde-4bb9-be1b-c6cd719630c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:44.724334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f313d7-bfde-4bb9-be1b-c6cd719630c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:44.732235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f313d7-bfde-4bb9-be1b-c6cd719630c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:44.733678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f313d7-bfde-4bb9-be1b-c6cd719630c0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-22f313d7-bfde-4bb9-be1b-c6cd719630c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:44.748473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:44.751181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:44.752637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:44.752637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:44.752637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:44.752637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:44.752637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:44.752637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:44.752637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:44.752637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:44.752637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 417/830] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:44.759849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea6963-1184-49d3-b1a3-b7968c2e5482 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:44.824778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f5c2-4e9b-463b-a06a-2450a813947e None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:44.825125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f5c2-4e9b-463b-a06a-2450a813947e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:44.825342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15f5c2-4e9b-463b-a06a-2450a813947e None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:44.826983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 418/831] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:44.832060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746ea6-1aa7-43b8-b569-50ff5a732201 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:44.832357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746ea6-1aa7-43b8-b569-50ff5a732201 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:44.832642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80746ea6-1aa7-43b8-b569-50ff5a732201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:44.850807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-80746ea6-1aa7-43b8-b569-50ff5a732201 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:44.852049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-80746ea6-1aa7-43b8-b569-50ff5a732201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:44.879299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea6963-1184-49d3-b1a3-b7968c2e5482 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:44.909940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:44.916302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353a71-5452-447c-a19b-f8a7b133d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:44.917258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353a71-5452-447c-a19b-f8a7b133d899 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:44.917638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353a71-5452-447c-a19b-f8a7b133d899 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:44.918038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353a71-5452-447c-a19b-f8a7b133d899 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:44.919459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353a71-5452-447c-a19b-f8a7b133d899 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:44.919776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353a71-5452-447c-a19b-f8a7b133d899 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:44.921399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353a71-5452-447c-a19b-f8a7b133d899 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:44.934732 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 419/832] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:44.936545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 414/833] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:44.942273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746ea6-1aa7-43b8-b569-50ff5a732201 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:44.955473 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353a71-5452-447c-a19b-f8a7b133d899 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:45.042482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:45.054882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80746ea6-1aa7-43b8-b569-50ff5a732201 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:45.079682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353a71-5452-447c-a19b-f8a7b133d899 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:45.095406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce86d5-b3a0-4293-ba71-58f4431ebf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:45.096834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce86d5-b3a0-4293-ba71-58f4431ebf19 None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:45.097329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce86d5-b3a0-4293-ba71-58f4431ebf19 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:45.097817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce86d5-b3a0-4293-ba71-58f4431ebf19 None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/8dcf5fbe26e44d858d5a2f708cd28c63/roles/758fd66475334e07a52a5472784207a7` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:45.117461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce86d5-b3a0-4293-ba71-58f4431ebf19 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=8dcf5fbe26e44d858d5a2f708cd28c63, role_id=758fd66475334e07a52a5472784207a7)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:45.119419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce86d5-b3a0-4293-ba71-58f4431ebf19 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:45.122443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b406f-4aa2-4c70-b505-b63e7bc55857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:45.123253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b406f-4aa2-4c70-b505-b63e7bc55857 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:45.123791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b406f-4aa2-4c70-b505-b63e7bc55857 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:45.123791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b406f-4aa2-4c70-b505-b63e7bc55857 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:45.124430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b406f-4aa2-4c70-b505-b63e7bc55857 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:45.125861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b406f-4aa2-4c70-b505-b63e7bc55857 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:45.137331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 420/834] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:37:44 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/8dcf5fbe26e44d858d5a2f708cd28c63/roles/758fd66475334e07a52a5472784207a7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-cf2b406f-4aa2-4c70-b505-b63e7bc55857 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:45.146869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:45.148116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:45.149275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 415/835] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:45.159299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce86d5-b3a0-4293-ba71-58f4431ebf19 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:45.283109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce86d5-b3a0-4293-ba71-58f4431ebf19 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:45.332964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e78591-a345-44c3-ae60-82f765b1f2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:45.333697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78591-a345-44c3-ae60-82f765b1f2d3 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:45.333927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78591-a345-44c3-ae60-82f765b1f2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:45.334204 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78591-a345-44c3-ae60-82f765b1f2d3 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:45.334942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78591-a345-44c3-ae60-82f765b1f2d3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:45.335251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78591-a345-44c3-ae60-82f765b1f2d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:45.336724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78591-a345-44c3-ae60-82f765b1f2d3 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:45.342176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 421/836] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:45.348673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b406f-4aa2-4c70-b505-b63e7bc55857 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:45.414819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:45.475230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b406f-4aa2-4c70-b505-b63e7bc55857 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:45.515099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499ff1e-f4d7-4156-b632-a9445c6e33a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:45.515769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499ff1e-f4d7-4156-b632-a9445c6e33a1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:45.516119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499ff1e-f4d7-4156-b632-a9445c6e33a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:45.516402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499ff1e-f4d7-4156-b632-a9445c6e33a1 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:45.517167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499ff1e-f4d7-4156-b632-a9445c6e33a1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:45.517482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499ff1e-f4d7-4156-b632-a9445c6e33a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:45.518918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499ff1e-f4d7-4156-b632-a9445c6e33a1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:45.532749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 416/837] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:45.591272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ad07b-6c0f-4167-b6a0-891a63607bb3 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:45.591490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ad07b-6c0f-4167-b6a0-891a63607bb3 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:45.591749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ad07b-6c0f-4167-b6a0-891a63607bb3 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:45.593536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 422/838] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:45.599353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d132c7a-a63d-4364-a9c4-afa2b38bd36f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:45.599650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d132c7a-a63d-4364-a9c4-afa2b38bd36f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:45.599941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d132c7a-a63d-4364-a9c4-afa2b38bd36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:45.619316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-5d132c7a-a63d-4364-a9c4-afa2b38bd36f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:45.620578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5d132c7a-a63d-4364-a9c4-afa2b38bd36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:45.708657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 417/839] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:45.733024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ad07b-6c0f-4167-b6a0-891a63607bb3 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:45.738385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:45.846200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ad07b-6c0f-4167-b6a0-891a63607bb3 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:45.883497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab481e-1ed4-472d-92e1-30514ca254c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:45.884702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab481e-1ed4-472d-92e1-30514ca254c7 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:45.885188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab481e-1ed4-472d-92e1-30514ca254c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:45.885691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab481e-1ed4-472d-92e1-30514ca254c7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:45.886592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab481e-1ed4-472d-92e1-30514ca254c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:45.888185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab481e-1ed4-472d-92e1-30514ca254c7 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-63ab481e-1ed4-472d-92e1-30514ca254c7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:45.901929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:45.902972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:37:45.903801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:45.906718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 423/840] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 23 10:37:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:45.918365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d132c7a-a63d-4364-a9c4-afa2b38bd36f None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:45.966448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:46.029686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d132c7a-a63d-4364-a9c4-afa2b38bd36f None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:46.068423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e16e8-6242-4ba7-996a-773fb7784e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:46.069095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e16e8-6242-4ba7-996a-773fb7784e8c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:46.069376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e16e8-6242-4ba7-996a-773fb7784e8c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:46.070168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e16e8-6242-4ba7-996a-773fb7784e8c None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:46.070920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e16e8-6242-4ba7-996a-773fb7784e8c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:46.071413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e16e8-6242-4ba7-996a-773fb7784e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:46.072790 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e16e8-6242-4ba7-996a-773fb7784e8c None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:46.077981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 418/841] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:37:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:46.083450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab481e-1ed4-472d-92e1-30514ca254c7 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:46.165734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:46.200615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab481e-1ed4-472d-92e1-30514ca254c7 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:46.235631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded89dd7-f21b-47a5-b338-30f56f1c6fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:46.236543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89dd7-f21b-47a5-b338-30f56f1c6fb8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:46.236990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89dd7-f21b-47a5-b338-30f56f1c6fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:46.237411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded89dd7-f21b-47a5-b338-30f56f1c6fb8 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:46.238266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded89dd7-f21b-47a5-b338-30f56f1c6fb8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:46.238835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded89dd7-f21b-47a5-b338-30f56f1c6fb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:46.240341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded89dd7-f21b-47a5-b338-30f56f1c6fb8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:46.245901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 424/842] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:37:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:46.502143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941a83-5d90-4599-9e77-75e4995fbc13 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:46.502368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941a83-5d90-4599-9e77-75e4995fbc13 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:46.502657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941a83-5d90-4599-9e77-75e4995fbc13 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:46.504277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 419/843] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:46.510778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32320b18-b197-4c73-ab6a-b847b21b4ec4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:46.511080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32320b18-b197-4c73-ab6a-b847b21b4ec4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:46.511349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32320b18-b197-4c73-ab6a-b847b21b4ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:46.537438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-32320b18-b197-4c73-ab6a-b847b21b4ec4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:46.537438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-32320b18-b197-4c73-ab6a-b847b21b4ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:46.605745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 425/844] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:46.631884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941a83-5d90-4599-9e77-75e4995fbc13 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:46.749690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941a83-5d90-4599-9e77-75e4995fbc13 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:46.764860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:46.786395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd09c0-a050-4414-8c2a-8ab24dce56a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:46.787193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd09c0-a050-4414-8c2a-8ab24dce56a8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:46.787473 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd09c0-a050-4414-8c2a-8ab24dce56a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:46.787748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd09c0-a050-4414-8c2a-8ab24dce56a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:46.799408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd09c0-a050-4414-8c2a-8ab24dce56a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-afdd09c0-a050-4414-8c2a-8ab24dce56a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:46.807152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:46.808134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:46.809003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 420/845] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:46.814513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32320b18-b197-4c73-ab6a-b847b21b4ec4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:46.879447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:46.918920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32320b18-b197-4c73-ab6a-b847b21b4ec4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:46.958530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd60b86-f9b8-451c-89e4-c9771210fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:46.959228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd60b86-f9b8-451c-89e4-c9771210fde0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:46.959508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd60b86-f9b8-451c-89e4-c9771210fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:46.959784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd60b86-f9b8-451c-89e4-c9771210fde0 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:46.960720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd60b86-f9b8-451c-89e4-c9771210fde0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:46.961244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd60b86-f9b8-451c-89e4-c9771210fde0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:46.962559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd60b86-f9b8-451c-89e4-c9771210fde0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:46.971964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 426/846] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:46.980442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd09c0-a050-4414-8c2a-8ab24dce56a8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:47.091882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd09c0-a050-4414-8c2a-8ab24dce56a8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:47.128002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a683017-528b-44a8-bb55-1b7f7653c03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:47.128867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a683017-528b-44a8-bb55-1b7f7653c03a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.129147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a683017-528b-44a8-bb55-1b7f7653c03a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.129421 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a683017-528b-44a8-bb55-1b7f7653c03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.141845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a683017-528b-44a8-bb55-1b7f7653c03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:47.143353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a683017-528b-44a8-bb55-1b7f7653c03a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-4a683017-528b-44a8-bb55-1b7f7653c03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:47.161949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:47.164943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:47.167095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:47.167095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:47.167095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:47.167095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:47.167095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 421/847] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:47.174348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd60b86-f9b8-451c-89e4-c9771210fde0 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:47.277728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd60b86-f9b8-451c-89e4-c9771210fde0 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:47.302062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:47.314331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7c091-9fd0-44fa-9a07-147f89100844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:47.315012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7c091-9fd0-44fa-9a07-147f89100844 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.315552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7c091-9fd0-44fa-9a07-147f89100844 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.315833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7c091-9fd0-44fa-9a07-147f89100844 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.316560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7c091-9fd0-44fa-9a07-147f89100844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:47.316868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7c091-9fd0-44fa-9a07-147f89100844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:47.318305 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7c091-9fd0-44fa-9a07-147f89100844 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:47.331412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 427/848] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:47.337069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a683017-528b-44a8-bb55-1b7f7653c03a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:47.388089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:47.445899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a683017-528b-44a8-bb55-1b7f7653c03a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:47.480917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370db8e-9481-4e38-946f-b9f1aece8778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:47.481709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370db8e-9481-4e38-946f-b9f1aece8778 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.482055 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370db8e-9481-4e38-946f-b9f1aece8778 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.482355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370db8e-9481-4e38-946f-b9f1aece8778 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.490612 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370db8e-9481-4e38-946f-b9f1aece8778 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:47.493086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370db8e-9481-4e38-946f-b9f1aece8778 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:47.506094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8b4cc-7c8d-475d-8f86-e5fd8e34fec4 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.506519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8b4cc-7c8d-475d-8f86-e5fd8e34fec4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.506784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8b4cc-7c8d-475d-8f86-e5fd8e34fec4 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-0370db8e-9481-4e38-946f-b9f1aece8778 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:47.507672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:47.510793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:37:47.514404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:47.516427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 428/849] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:37:47.516644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 422/850] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:37:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:47.532721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c424b2-d851-47d9-aca5-06b7670a5312 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.532721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c424b2-d851-47d9-aca5-06b7670a5312 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.532721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c424b2-d851-47d9-aca5-06b7670a5312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.533149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370db8e-9481-4e38-946f-b9f1aece8778 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:47.533297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c6c424b2-d851-47d9-aca5-06b7670a5312 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:47.540322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c6c424b2-d851-47d9-aca5-06b7670a5312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:47.613274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:47.614575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 429/851] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:47.630530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370db8e-9481-4e38-946f-b9f1aece8778 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:47.631284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c424b2-d851-47d9-aca5-06b7670a5312 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:47.669483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90962f7c-de9d-4ee8-b0f5-ef3c0e1fde25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:47.670211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90962f7c-de9d-4ee8-b0f5-ef3c0e1fde25 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.670533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90962f7c-de9d-4ee8-b0f5-ef3c0e1fde25 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.670816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90962f7c-de9d-4ee8-b0f5-ef3c0e1fde25 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.671659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90962f7c-de9d-4ee8-b0f5-ef3c0e1fde25 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:47.671971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90962f7c-de9d-4ee8-b0f5-ef3c0e1fde25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:47.673419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90962f7c-de9d-4ee8-b0f5-ef3c0e1fde25 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:47.692538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 423/852] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jun 23 10:37:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:47.698483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90962f7c-de9d-4ee8-b0f5-ef3c0e1fde25 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:47.737865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c424b2-d851-47d9-aca5-06b7670a5312 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:47.752857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:47.773949 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ff92f-758a-47ac-87c4-9b6fa87ce063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:47.774779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff92f-758a-47ac-87c4-9b6fa87ce063 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.775054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff92f-758a-47ac-87c4-9b6fa87ce063 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.775328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ff92f-758a-47ac-87c4-9b6fa87ce063 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.786016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ff92f-758a-47ac-87c4-9b6fa87ce063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-b59ff92f-758a-47ac-87c4-9b6fa87ce063 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:47.794478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:47.795547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:37:47.796426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:47.800588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 430/853] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:37:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:47.801922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d2f6-85f6-405d-a7bb-af5e46353973 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.802210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d2f6-85f6-405d-a7bb-af5e46353973 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.802510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2d2f6-85f6-405d-a7bb-af5e46353973 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.803799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 431/854] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:47.806587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d2f6-85f6-405d-a7bb-af5e46353973 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:47.811948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90962f7c-de9d-4ee8-b0f5-ef3c0e1fde25 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:47.850131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3db70-644f-4a92-8abb-abf671f9d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:47.850815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3db70-644f-4a92-8abb-abf671f9d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.851661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3db70-644f-4a92-8abb-abf671f9d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.851944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3db70-644f-4a92-8abb-abf671f9d6e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.868734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:47.930308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3db70-644f-4a92-8abb-abf671f9d6e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:47.931672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c3db70-644f-4a92-8abb-abf671f9d6e4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:47.932619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2d2f6-85f6-405d-a7bb-af5e46353973 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:47.968585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18c92b-f061-485e-8146-2ddbf7775538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:47.969250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c92b-f061-485e-8146-2ddbf7775538 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.969537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c92b-f061-485e-8146-2ddbf7775538 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.969819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18c92b-f061-485e-8146-2ddbf7775538 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:47.970696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c92b-f061-485e-8146-2ddbf7775538 None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:47.971009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c92b-f061-485e-8146-2ddbf7775538 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:47.972425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18c92b-f061-485e-8146-2ddbf7775538 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:47.981778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 432/855] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:37:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:47.983731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a769f4-cc4d-4a0e-8d1c-047953a57c48 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:47.984026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a769f4-cc4d-4a0e-8d1c-047953a57c48 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:47.984308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a769f4-cc4d-4a0e-8d1c-047953a57c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.002340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-86a769f4-cc4d-4a0e-8d1c-047953a57c48 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:48.003590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-86a769f4-cc4d-4a0e-8d1c-047953a57c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:48.045154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:48.055273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 424/856] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:37:48.056860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3db70-644f-4a92-8abb-abf671f9d6e4 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:48.102369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 433/857] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:48.102369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a769f4-cc4d-4a0e-8d1c-047953a57c48 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:48.110108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:48.171775 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3db70-644f-4a92-8abb-abf671f9d6e4 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:48.209074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467bd0b-4bf2-4427-89a9-da7f229fc908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:48.209832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467bd0b-4bf2-4427-89a9-da7f229fc908 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.210122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467bd0b-4bf2-4427-89a9-da7f229fc908 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.210429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467bd0b-4bf2-4427-89a9-da7f229fc908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.218356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a769f4-cc4d-4a0e-8d1c-047953a57c48 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:48.223617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467bd0b-4bf2-4427-89a9-da7f229fc908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:48.225591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467bd0b-4bf2-4427-89a9-da7f229fc908 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-c467bd0b-4bf2-4427-89a9-da7f229fc908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:48.246608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:48.247606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:48.248526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:48.248526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:48.248526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:48.248526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:48.248526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 425/858] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:48.248815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467bd0b-4bf2-4427-89a9-da7f229fc908 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:48.270344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc49aa-2e09-4cf0-a7ea-aca03fa04c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:48.271163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc49aa-2e09-4cf0-a7ea-aca03fa04c32 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.271455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc49aa-2e09-4cf0-a7ea-aca03fa04c32 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.271734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc49aa-2e09-4cf0-a7ea-aca03fa04c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.285560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc49aa-2e09-4cf0-a7ea-aca03fa04c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:48.286423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc49aa-2e09-4cf0-a7ea-aca03fa04c32 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-c2dc49aa-2e09-4cf0-a7ea-aca03fa04c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:48.309064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:48.310073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:48.311143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:48.311143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:48.311143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:48.311143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:48.311143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 434/859] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:48.311143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc49aa-2e09-4cf0-a7ea-aca03fa04c32 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:48.332274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:48.363887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:48.372234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467bd0b-4bf2-4427-89a9-da7f229fc908 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:48.411036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49796122-bd6e-44cc-8834-ae4079de31cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:48.411974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49796122-bd6e-44cc-8834-ae4079de31cf None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.412533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49796122-bd6e-44cc-8834-ae4079de31cf None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.413071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49796122-bd6e-44cc-8834-ae4079de31cf None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.414527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49796122-bd6e-44cc-8834-ae4079de31cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:48.416063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49796122-bd6e-44cc-8834-ae4079de31cf None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:48.416563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc49aa-2e09-4cf0-a7ea-aca03fa04c32 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:48.432356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 426/860] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:37:48 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:48.433409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49796122-bd6e-44cc-8834-ae4079de31cf None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:48.473423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc53ee1-495c-477b-baa7-4dc2c952cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:48.474549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc53ee1-495c-477b-baa7-4dc2c952cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.475095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc53ee1-495c-477b-baa7-4dc2c952cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.475372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc53ee1-495c-477b-baa7-4dc2c952cbc7 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.476838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc53ee1-495c-477b-baa7-4dc2c952cbc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:48.477157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc53ee1-495c-477b-baa7-4dc2c952cbc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:48.478909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc53ee1-495c-477b-baa7-4dc2c952cbc7 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:48.498517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 435/861] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:48.501653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc53ee1-495c-477b-baa7-4dc2c952cbc7 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:48.582911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49796122-bd6e-44cc-8834-ae4079de31cf None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:48.601122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:48.634940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792a512-a8d7-4a44-8851-0c828ea54c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:48.635619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792a512-a8d7-4a44-8851-0c828ea54c8f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.635898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792a512-a8d7-4a44-8851-0c828ea54c8f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.636171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792a512-a8d7-4a44-8851-0c828ea54c8f None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.636904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792a512-a8d7-4a44-8851-0c828ea54c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:48.637213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792a512-a8d7-4a44-8851-0c828ea54c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:48.638624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792a512-a8d7-4a44-8851-0c828ea54c8f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:48.640705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc53ee1-495c-477b-baa7-4dc2c952cbc7 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:48.652551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 427/862] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:48.653881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daa6ba-7072-4eaa-948a-91c80af5fb97 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.654167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daa6ba-7072-4eaa-948a-91c80af5fb97 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.654512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daa6ba-7072-4eaa-948a-91c80af5fb97 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.655963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 428/863] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:48.658053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daa6ba-7072-4eaa-948a-91c80af5fb97 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:48.680173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:48.681524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53c7bb-b339-4153-8611-6286f91ac915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:48.682912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53c7bb-b339-4153-8611-6286f91ac915 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.683213 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53c7bb-b339-4153-8611-6286f91ac915 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.683536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53c7bb-b339-4153-8611-6286f91ac915 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.692767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53c7bb-b339-4153-8611-6286f91ac915 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:48.694269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53c7bb-b339-4153-8611-6286f91ac915 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-3c53c7bb-b339-4153-8611-6286f91ac915 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:48.710622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:48.711740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:48.712778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 436/864] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:37:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:48.713405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3003-ef17-4e71-8bcc-9442df65399f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.713405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3003-ef17-4e71-8bcc-9442df65399f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.714540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3003-ef17-4e71-8bcc-9442df65399f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.730544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-b99e3003-ef17-4e71-8bcc-9442df65399f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:48.731900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b99e3003-ef17-4e71-8bcc-9442df65399f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:48.779785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daa6ba-7072-4eaa-948a-91c80af5fb97 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:48.818353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 437/865] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:48.818353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e3003-ef17-4e71-8bcc-9442df65399f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:48.831005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b970ce6-2316-444e-b3f5-dcea7930007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:48.832246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b970ce6-2316-444e-b3f5-dcea7930007d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.832534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b970ce6-2316-444e-b3f5-dcea7930007d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.832971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b970ce6-2316-444e-b3f5-dcea7930007d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.842757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b970ce6-2316-444e-b3f5-dcea7930007d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:48.845162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b970ce6-2316-444e-b3f5-dcea7930007d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-9b970ce6-2316-444e-b3f5-dcea7930007d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:48.860249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:48.861391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:48.862493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:48.862493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:48.862493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:48.862493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:48.862493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:48.862493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:48.862493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:48.862493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:48.862493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 429/866] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:48.863026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b970ce6-2316-444e-b3f5-dcea7930007d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:48.879923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:48.922858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e3003-ef17-4e71-8bcc-9442df65399f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:48.945885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:48.964142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71bafe-1aee-49d6-83e1-4b69acb67092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:48.964894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71bafe-1aee-49d6-83e1-4b69acb67092 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:48.965268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71bafe-1aee-49d6-83e1-4b69acb67092 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:48.965550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71bafe-1aee-49d6-83e1-4b69acb67092 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:48.966433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71bafe-1aee-49d6-83e1-4b69acb67092 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:48.966772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71bafe-1aee-49d6-83e1-4b69acb67092 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:48.968201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71bafe-1aee-49d6-83e1-4b69acb67092 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:48.978295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b970ce6-2316-444e-b3f5-dcea7930007d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:48.989404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 438/867] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 23 10:37:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:48.990258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71bafe-1aee-49d6-83e1-4b69acb67092 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:49.024154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a769de-7458-4390-ab7d-bcf97521eceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:49.024821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a769de-7458-4390-ab7d-bcf97521eceb None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:49.025111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a769de-7458-4390-ab7d-bcf97521eceb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:49.025394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a769de-7458-4390-ab7d-bcf97521eceb None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:49.026120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a769de-7458-4390-ab7d-bcf97521eceb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:49.027532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a769de-7458-4390-ab7d-bcf97521eceb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:49.045568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 430/868] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:37:48 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:49.046500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a769de-7458-4390-ab7d-bcf97521eceb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:49.150340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71bafe-1aee-49d6-83e1-4b69acb67092 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:49.184636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:49.195681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a769de-7458-4390-ab7d-bcf97521eceb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:49.198333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31c356-553c-46b6-9556-d2a40136852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:49.199126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31c356-553c-46b6-9556-d2a40136852f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:49.199430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31c356-553c-46b6-9556-d2a40136852f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:49.199695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31c356-553c-46b6-9556-d2a40136852f None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:49.201587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31c356-553c-46b6-9556-d2a40136852f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:49.201907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31c356-553c-46b6-9556-d2a40136852f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:49.203450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31c356-553c-46b6-9556-d2a40136852f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:49.228119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 439/869] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:49.230952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31c356-553c-46b6-9556-d2a40136852f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:49.243113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:49.251966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e9a15-b1bb-4386-916d-2e8b275ea9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:49.253340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e9a15-b1bb-4386-916d-2e8b275ea9cb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:49.253340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e9a15-b1bb-4386-916d-2e8b275ea9cb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:49.253340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e9a15-b1bb-4386-916d-2e8b275ea9cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:49.339935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e9a15-b1bb-4386-916d-2e8b275ea9cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:49.344045 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e9a15-b1bb-4386-916d-2e8b275ea9cb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:49.363177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31c356-553c-46b6-9556-d2a40136852f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:49.416762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac7087-4d7f-471f-9d07-3a22802819ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:49.417422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac7087-4d7f-471f-9d07-3a22802819ff None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:49.417697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac7087-4d7f-471f-9d07-3a22802819ff None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:49.417971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac7087-4d7f-471f-9d07-3a22802819ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:49.418835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac7087-4d7f-471f-9d07-3a22802819ff None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=cbf19adc48f0439b9cdcb1aaedd58a01) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:49.419146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac7087-4d7f-471f-9d07-3a22802819ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:49.420577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac7087-4d7f-471f-9d07-3a22802819ff None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:49.427216 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 440/870] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:49 2022] GET /identity/v3/role_assignments?user.id=cbf19adc48f0439b9cdcb1aaedd58a01&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:49.480328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 431/871] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:49 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:37:49.486370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac7087-4d7f-471f-9d07-3a22802819ff None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:49.544710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:49.636291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac7087-4d7f-471f-9d07-3a22802819ff None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:49.700214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8724a-919d-4367-a302-17c3f6c3b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:49.701592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8724a-919d-4367-a302-17c3f6c3b48e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:49.702090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8724a-919d-4367-a302-17c3f6c3b48e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:49.702619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8724a-919d-4367-a302-17c3f6c3b48e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:49.722669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8724a-919d-4367-a302-17c3f6c3b48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:49.725625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8724a-919d-4367-a302-17c3f6c3b48e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-aaf8724a-919d-4367-a302-17c3f6c3b48e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:49.758752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:49.759707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:49.760621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:49.760621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:49.760621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:49.760621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:49.762019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 441/872] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:49.766636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e9a15-b1bb-4386-916d-2e8b275ea9cb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:49.800437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:49.880161 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e9a15-b1bb-4386-916d-2e8b275ea9cb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:49.916470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4b862-65d0-4b08-a9e9-388da7318e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:49.917139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4b862-65d0-4b08-a9e9-388da7318e56 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:49.917427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4b862-65d0-4b08-a9e9-388da7318e56 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:49.917709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4b862-65d0-4b08-a9e9-388da7318e56 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:49.918465 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4b862-65d0-4b08-a9e9-388da7318e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:49.918781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4b862-65d0-4b08-a9e9-388da7318e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:49.920150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4b862-65d0-4b08-a9e9-388da7318e56 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:49.932381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 432/873] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:49.937593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8724a-919d-4367-a302-17c3f6c3b48e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:50.041846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:50.047272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8724a-919d-4367-a302-17c3f6c3b48e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:50.083809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b150-d56c-417d-a13f-b3adccfc0861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:50.084599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b150-d56c-417d-a13f-b3adccfc0861 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:50.084879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b150-d56c-417d-a13f-b3adccfc0861 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:50.085154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08b150-d56c-417d-a13f-b3adccfc0861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:50.093159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08b150-d56c-417d-a13f-b3adccfc0861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:50.094625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08b150-d56c-417d-a13f-b3adccfc0861 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-ff08b150-d56c-417d-a13f-b3adccfc0861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:50.110184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:50.112494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:50.114701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:50.114701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:50.114701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:50.114701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:50.114701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:50.114701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:50.114701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:50.114701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:50.118342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 442/874] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:50.118548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4b862-65d0-4b08-a9e9-388da7318e56 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:50.214917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:50.224546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4b862-65d0-4b08-a9e9-388da7318e56 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:50.267339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c782434-d921-42b1-8869-db87d7a9af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:50.268006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c782434-d921-42b1-8869-db87d7a9af99 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:50.268293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c782434-d921-42b1-8869-db87d7a9af99 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:50.268575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c782434-d921-42b1-8869-db87d7a9af99 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:50.269367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c782434-d921-42b1-8869-db87d7a9af99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:50.269682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c782434-d921-42b1-8869-db87d7a9af99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:50.271142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c782434-d921-42b1-8869-db87d7a9af99 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:50.284773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 433/875] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:50.291487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b150-d56c-417d-a13f-b3adccfc0861 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:50.400260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08b150-d56c-417d-a13f-b3adccfc0861 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:50.436763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9cb25-350d-4fe8-b0aa-0df0b089406a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:50.437407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9cb25-350d-4fe8-b0aa-0df0b089406a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:50.437688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9cb25-350d-4fe8-b0aa-0df0b089406a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:50.437963 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9cb25-350d-4fe8-b0aa-0df0b089406a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:50.438853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9cb25-350d-4fe8-b0aa-0df0b089406a None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=8dcf5fbe26e44d858d5a2f708cd28c63) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:50.439162 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9cb25-350d-4fe8-b0aa-0df0b089406a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:50.440850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9cb25-350d-4fe8-b0aa-0df0b089406a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:50.454541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 443/876] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:50 2022] GET /identity/v3/role_assignments?user.id=8dcf5fbe26e44d858d5a2f708cd28c63&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:50.643572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc52b6-a476-4634-b086-11c87a76dadc None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:50.643889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc52b6-a476-4634-b086-11c87a76dadc None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:50.644117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc52b6-a476-4634-b086-11c87a76dadc None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:50.645765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 434/877] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:50.652158 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa621d-b469-4b91-be1d-ff763b97b7c2 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:50.652382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa621d-b469-4b91-be1d-ff763b97b7c2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:50.652657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa621d-b469-4b91-be1d-ff763b97b7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:50.671738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-b7aa621d-b469-4b91-be1d-ff763b97b7c2 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:50.672954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b7aa621d-b469-4b91-be1d-ff763b97b7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:50.694218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:50.754437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 444/878] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:50.771863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc52b6-a476-4634-b086-11c87a76dadc None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:50.878172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc52b6-a476-4634-b086-11c87a76dadc None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:50.913262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f53a7-500b-4bf0-a40a-4b2f5fb6d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:50.914529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f53a7-500b-4bf0-a40a-4b2f5fb6d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:50.914813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f53a7-500b-4bf0-a40a-4b2f5fb6d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:50.915087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f53a7-500b-4bf0-a40a-4b2f5fb6d7e3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:50.915787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f53a7-500b-4bf0-a40a-4b2f5fb6d7e3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:50.917162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f53a7-500b-4bf0-a40a-4b2f5fb6d7e3 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-3a2f53a7-500b-4bf0-a40a-4b2f5fb6d7e3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:50.930292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:50.932634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:37:50.934703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:50.936470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 435/879] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:50.939588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa621d-b469-4b91-be1d-ff763b97b7c2 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:51.041915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa621d-b469-4b91-be1d-ff763b97b7c2 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:51.078079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e54598-b355-4a13-8195-b8428c884967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:51.078793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e54598-b355-4a13-8195-b8428c884967 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.079040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e54598-b355-4a13-8195-b8428c884967 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.079314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e54598-b355-4a13-8195-b8428c884967 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.080029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e54598-b355-4a13-8195-b8428c884967 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:51.080329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e54598-b355-4a13-8195-b8428c884967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:51.081701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e54598-b355-4a13-8195-b8428c884967 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:51.092484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 445/880] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:51.093919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f53a7-500b-4bf0-a40a-4b2f5fb6d7e3 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:51.119085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:51.205797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f53a7-500b-4bf0-a40a-4b2f5fb6d7e3 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:51.242252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc061e-5c34-41f4-b3e8-d4252f79646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:51.243786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc061e-5c34-41f4-b3e8-d4252f79646f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.244335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc061e-5c34-41f4-b3e8-d4252f79646f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.244807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc061e-5c34-41f4-b3e8-d4252f79646f None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.245727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc061e-5c34-41f4-b3e8-d4252f79646f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:51.246228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc061e-5c34-41f4-b3e8-d4252f79646f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:51.247830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc061e-5c34-41f4-b3e8-d4252f79646f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:51.256851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 436/881] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:51.263370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e54598-b355-4a13-8195-b8428c884967 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:51.310744 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:51.324681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef5e8-774f-4cc4-8d95-7cc460319464 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.325066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef5e8-774f-4cc4-8d95-7cc460319464 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.325407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ef5e8-774f-4cc4-8d95-7cc460319464 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.327093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 437/882] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:37:51.332052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbcb68-7674-48d5-9491-28bfa6036911 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.332339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbcb68-7674-48d5-9491-28bfa6036911 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.332623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbcb68-7674-48d5-9491-28bfa6036911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.352100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-1ddbcb68-7674-48d5-9491-28bfa6036911 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:51.353447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1ddbcb68-7674-48d5-9491-28bfa6036911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:51.376865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e54598-b355-4a13-8195-b8428c884967 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:51.415791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ae2f9-c5eb-4f1c-9869-98c5a4beb324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:51.416811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae2f9-c5eb-4f1c-9869-98c5a4beb324 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.417291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae2f9-c5eb-4f1c-9869-98c5a4beb324 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.417817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae2f9-c5eb-4f1c-9869-98c5a4beb324 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.418737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ae2f9-c5eb-4f1c-9869-98c5a4beb324 None admin] RBAC: Adding query filter params (interface=public, service_id=72e9f5f1f49044198cc2f45c9bcb5097, region_id=RegionOne) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:51.419115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ae2f9-c5eb-4f1c-9869-98c5a4beb324 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:51.420559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ae2f9-c5eb-4f1c-9869-98c5a4beb324 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:51.426449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 446/883] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 23 10:37:51 2022] GET /identity/v3/endpoints?service_id=72e9f5f1f49044198cc2f45c9bcb5097&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:51.432774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ae2f9-c5eb-4f1c-9869-98c5a4beb324 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:51.454506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 438/884] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:51.474034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbcb68-7674-48d5-9491-28bfa6036911 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:51.489659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:51.546415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:51.576554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ae2f9-c5eb-4f1c-9869-98c5a4beb324 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:51.605026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbcb68-7674-48d5-9491-28bfa6036911 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:51.629849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42132c-ee88-4479-8fc7-677a0d38aa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:51.631550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42132c-ee88-4479-8fc7-677a0d38aa77 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.632949 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42132c-ee88-4479-8fc7-677a0d38aa77 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.633540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42132c-ee88-4479-8fc7-677a0d38aa77 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.635138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42132c-ee88-4479-8fc7-677a0d38aa77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:51.637292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42132c-ee88-4479-8fc7-677a0d38aa77 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:51.644344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 447/885] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 23 10:37:51 2022] GET /identity/v3/services => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:37:51.651340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773b25f-2ecd-4675-8d16-b468076865b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:51.653082 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773b25f-2ecd-4675-8d16-b468076865b8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.653834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773b25f-2ecd-4675-8d16-b468076865b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.654799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773b25f-2ecd-4675-8d16-b468076865b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.656218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773b25f-2ecd-4675-8d16-b468076865b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:51.658570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773b25f-2ecd-4675-8d16-b468076865b8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-4773b25f-2ecd-4675-8d16-b468076865b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:51.673516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:51.674574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:37:51.675463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:51.678700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 439/886] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 23 10:37:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:51.685507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42132c-ee88-4479-8fc7-677a0d38aa77 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:51.745176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4019e-cb09-4463-8268-c59c09fe8dd8 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.745806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4019e-cb09-4463-8268-c59c09fe8dd8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.746291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4019e-cb09-4463-8268-c59c09fe8dd8 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.748513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 440/887] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:37:51.754346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498d530-5798-436c-bd85-a3a6a204b505 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.754659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498d530-5798-436c-bd85-a3a6a204b505 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.754934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498d530-5798-436c-bd85-a3a6a204b505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.774169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7498d530-5798-436c-bd85-a3a6a204b505 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:51.775442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7498d530-5798-436c-bd85-a3a6a204b505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:51.812437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42132c-ee88-4479-8fc7-677a0d38aa77 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:51.864302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 441/888] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 23 10:37:51.873588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a9af-5e09-442d-b7d0-fec90d49e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:51.874256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a9af-5e09-442d-b7d0-fec90d49e542 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:51.874599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a9af-5e09-442d-b7d0-fec90d49e542 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:51.874880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a9af-5e09-442d-b7d0-fec90d49e542 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:51.875589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a9af-5e09-442d-b7d0-fec90d49e542 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:51.875899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a9af-5e09-442d-b7d0-fec90d49e542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:51.877260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a9af-5e09-442d-b7d0-fec90d49e542 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:51.886349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 448/889] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:37:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:51.888391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498d530-5798-436c-bd85-a3a6a204b505 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:51.893493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:51.909281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a9af-5e09-442d-b7d0-fec90d49e542 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:51.929679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:52.000639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498d530-5798-436c-bd85-a3a6a204b505 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:52.038609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19520069-c6ef-4e7f-b329-7f431fd2f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:52.039643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19520069-c6ef-4e7f-b329-7f431fd2f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:52.039937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19520069-c6ef-4e7f-b329-7f431fd2f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:52.040222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19520069-c6ef-4e7f-b329-7f431fd2f9d7 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:52.040946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19520069-c6ef-4e7f-b329-7f431fd2f9d7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:52.041260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19520069-c6ef-4e7f-b329-7f431fd2f9d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:52.043165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19520069-c6ef-4e7f-b329-7f431fd2f9d7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:52.050565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 442/890] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:37:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:52.056546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a9af-5e09-442d-b7d0-fec90d49e542 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:52.058109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19520069-c6ef-4e7f-b329-7f431fd2f9d7 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:52.097235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836cee-5774-4f53-aeaa-9c43b102ed3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:52.098144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836cee-5774-4f53-aeaa-9c43b102ed3f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:52.098588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836cee-5774-4f53-aeaa-9c43b102ed3f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:52.099024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836cee-5774-4f53-aeaa-9c43b102ed3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:52.100291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b836cee-5774-4f53-aeaa-9c43b102ed3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:52.102833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b836cee-5774-4f53-aeaa-9c43b102ed3f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-0b836cee-5774-4f53-aeaa-9c43b102ed3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:52.118004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:52.119298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:37:52.120153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:52.124986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 449/891] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:37:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:52.126451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836cee-5774-4f53-aeaa-9c43b102ed3f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:52.153879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:52.217361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19520069-c6ef-4e7f-b329-7f431fd2f9d7 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:52.225632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:52.266104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836cee-5774-4f53-aeaa-9c43b102ed3f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:52.270504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60e0b8-46b5-4bc5-8612-41200023581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:52.271691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60e0b8-46b5-4bc5-8612-41200023581d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:52.272143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60e0b8-46b5-4bc5-8612-41200023581d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:52.272560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60e0b8-46b5-4bc5-8612-41200023581d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:52.274440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60e0b8-46b5-4bc5-8612-41200023581d None admin] RBAC: Adding query filter params (interface=public, service_id=4461602f3aeb41deade40c7a928ffc94, region_id=RegionOne) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:52.274925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60e0b8-46b5-4bc5-8612-41200023581d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:52.277157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60e0b8-46b5-4bc5-8612-41200023581d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:52.286631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 443/892] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 23 10:37:52 2022] GET /identity/v3/endpoints?service_id=4461602f3aeb41deade40c7a928ffc94&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:52.293970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60e0b8-46b5-4bc5-8612-41200023581d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:52.322831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8307f99-9b90-4c30-ab6c-cb4f0d4da905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:52.323547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8307f99-9b90-4c30-ab6c-cb4f0d4da905 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:52.323834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8307f99-9b90-4c30-ab6c-cb4f0d4da905 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:52.324114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8307f99-9b90-4c30-ab6c-cb4f0d4da905 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:52.324824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8307f99-9b90-4c30-ab6c-cb4f0d4da905 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:52.325131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8307f99-9b90-4c30-ab6c-cb4f0d4da905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:52.326527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8307f99-9b90-4c30-ab6c-cb4f0d4da905 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:52.336850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 450/893] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:37:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:52.338244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8307f99-9b90-4c30-ab6c-cb4f0d4da905 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:52.412875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60e0b8-46b5-4bc5-8612-41200023581d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:52.447224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:52.455494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceeb71-64c3-421b-9072-e43e7f51a79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:52.456857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceeb71-64c3-421b-9072-e43e7f51a79b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:52.457431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceeb71-64c3-421b-9072-e43e7f51a79b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:52.457915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceeb71-64c3-421b-9072-e43e7f51a79b None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:52.459474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceeb71-64c3-421b-9072-e43e7f51a79b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:52.461752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceeb71-64c3-421b-9072-e43e7f51a79b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:52.478862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 444/894] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 23 10:37:52 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:37:52.485106 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8307f99-9b90-4c30-ab6c-cb4f0d4da905 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:52.525312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c87b4-a28e-4d31-a818-5e83e18acc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:52.525954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c87b4-a28e-4d31-a818-5e83e18acc04 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:52.526241 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c87b4-a28e-4d31-a818-5e83e18acc04 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:52.526638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c87b4-a28e-4d31-a818-5e83e18acc04 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:52.527357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c87b4-a28e-4d31-a818-5e83e18acc04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:52.527661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c87b4-a28e-4d31-a818-5e83e18acc04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:52.529092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c87b4-a28e-4d31-a818-5e83e18acc04 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:52.534670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 451/895] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:37:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:52.534978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:52.651662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21f4e8-1dac-4e1d-92b0-077a12224f3b None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:52.652003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21f4e8-1dac-4e1d-92b0-077a12224f3b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:52.652219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21f4e8-1dac-4e1d-92b0-077a12224f3b None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:52.653789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 445/896] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:52.659842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a81c39-8fd0-4347-909a-9c8d055b50ae None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:52.660495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a81c39-8fd0-4347-909a-9c8d055b50ae None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:52.660988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a81c39-8fd0-4347-909a-9c8d055b50ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:52.686987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-05a81c39-8fd0-4347-909a-9c8d055b50ae None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:52.688560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-05a81c39-8fd0-4347-909a-9c8d055b50ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:52.766758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 452/897] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:52.791296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21f4e8-1dac-4e1d-92b0-077a12224f3b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:52.900156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21f4e8-1dac-4e1d-92b0-077a12224f3b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:52.942783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a2e9-2c4b-4609-881f-2b889ee0e85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:52.943578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a2e9-2c4b-4609-881f-2b889ee0e85f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:52.943860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a2e9-2c4b-4609-881f-2b889ee0e85f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:52.944159 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a2e9-2c4b-4609-881f-2b889ee0e85f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:52.956046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a2e9-2c4b-4609-881f-2b889ee0e85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-b996a2e9-2c4b-4609-881f-2b889ee0e85f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:52.965196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:52.966155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:52.967123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 446/898] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 23 10:37:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:52.974063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a81c39-8fd0-4347-909a-9c8d055b50ae None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:53.079592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a81c39-8fd0-4347-909a-9c8d055b50ae None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:53.114311 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:53.120953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20cea6-452a-4b69-8170-a4410ca3ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:53.121632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20cea6-452a-4b69-8170-a4410ca3ace0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:53.121923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20cea6-452a-4b69-8170-a4410ca3ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:53.122197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20cea6-452a-4b69-8170-a4410ca3ace0 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:53.122978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20cea6-452a-4b69-8170-a4410ca3ace0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:53.123285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20cea6-452a-4b69-8170-a4410ca3ace0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:53.124651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20cea6-452a-4b69-8170-a4410ca3ace0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:53.134706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 453/899] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 23 10:37:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:53.140283 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a2e9-2c4b-4609-881f-2b889ee0e85f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:53.202127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:53.256984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a2e9-2c4b-4609-881f-2b889ee0e85f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:53.293721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c6135-4e76-42c7-8abf-daaa3b857686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:53.295338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c6135-4e76-42c7-8abf-daaa3b857686 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:53.295840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c6135-4e76-42c7-8abf-daaa3b857686 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:53.296291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c6135-4e76-42c7-8abf-daaa3b857686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:53.307767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c6135-4e76-42c7-8abf-daaa3b857686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:53.309457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c6135-4e76-42c7-8abf-daaa3b857686 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-e38c6135-4e76-42c7-8abf-daaa3b857686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:53.328319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:53.329343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:53.330335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:53.330335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:53.330335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:53.330335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:53.332352 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 447/900] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:53.344122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20cea6-452a-4b69-8170-a4410ca3ace0 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:53.450540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20cea6-452a-4b69-8170-a4410ca3ace0 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:53.486549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59df8b-9f34-49c8-a97f-eee41279fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:53.487214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59df8b-9f34-49c8-a97f-eee41279fb5b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:53.487499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59df8b-9f34-49c8-a97f-eee41279fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:53.487780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59df8b-9f34-49c8-a97f-eee41279fb5b None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:53.488504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59df8b-9f34-49c8-a97f-eee41279fb5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:53.488813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59df8b-9f34-49c8-a97f-eee41279fb5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:53.490179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59df8b-9f34-49c8-a97f-eee41279fb5b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:53.502995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 454/901] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:53.509165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c6135-4e76-42c7-8abf-daaa3b857686 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:53.617466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c6135-4e76-42c7-8abf-daaa3b857686 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:53.626921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:53.654047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f8b07-24d9-45b9-9e6f-9465d2b9d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:53.654899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f8b07-24d9-45b9-9e6f-9465d2b9d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:53.655184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f8b07-24d9-45b9-9e6f-9465d2b9d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:53.655461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f8b07-24d9-45b9-9e6f-9465d2b9d4a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:53.664046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f8b07-24d9-45b9-9e6f-9465d2b9d4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:53.665625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f8b07-24d9-45b9-9e6f-9465d2b9d4a1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-2c5f8b07-24d9-45b9-9e6f-9465d2b9d4a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:53.681124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:53.682341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:53.683493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 448/902] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:37:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:53.688748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59df8b-9f34-49c8-a97f-eee41279fb5b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:53.758006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:53.814609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59df8b-9f34-49c8-a97f-eee41279fb5b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:53.841111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1a11-4e75-4dbd-ad15-830e124b5f38 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:53.841402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1a11-4e75-4dbd-ad15-830e124b5f38 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:53.841692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c1a11-4e75-4dbd-ad15-830e124b5f38 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:53.843350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 449/903] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:53.848296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffcbb8-2f1e-4582-bcbb-ca37267c464c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:53.848587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffcbb8-2f1e-4582-bcbb-ca37267c464c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:53.848885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffcbb8-2f1e-4582-bcbb-ca37267c464c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:53.855990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857ed8-eba2-4725-802b-f7896159816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:53.856669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857ed8-eba2-4725-802b-f7896159816a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:53.856960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857ed8-eba2-4725-802b-f7896159816a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:53.857244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7857ed8-eba2-4725-802b-f7896159816a None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:53.858096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7857ed8-eba2-4725-802b-f7896159816a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:53.858449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7857ed8-eba2-4725-802b-f7896159816a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:53.859888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7857ed8-eba2-4725-802b-f7896159816a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:53.869725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d5ffcbb8-2f1e-4582-bcbb-ca37267c464c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:53.875950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d5ffcbb8-2f1e-4582-bcbb-ca37267c464c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:53.882847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 455/904] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 23 10:37:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:53.886207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857ed8-eba2-4725-802b-f7896159816a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:53.977170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 450/905] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:54.001257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffcbb8-2f1e-4582-bcbb-ca37267c464c None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:54.021811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7857ed8-eba2-4725-802b-f7896159816a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:54.036044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:54.064463 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581dd89-da39-47c2-8f86-6e683de01575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:54.065693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581dd89-da39-47c2-8f86-6e683de01575 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.066080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581dd89-da39-47c2-8f86-6e683de01575 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.066498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581dd89-da39-47c2-8f86-6e683de01575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.153219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:54.153479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581dd89-da39-47c2-8f86-6e683de01575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:54.155164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581dd89-da39-47c2-8f86-6e683de01575 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:54.159736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffcbb8-2f1e-4582-bcbb-ca37267c464c None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:54.215497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68529021-4877-4227-b753-8a612c99cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:54.216689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68529021-4877-4227-b753-8a612c99cd39 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.221806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68529021-4877-4227-b753-8a612c99cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.222253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68529021-4877-4227-b753-8a612c99cd39 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.223207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68529021-4877-4227-b753-8a612c99cd39 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:54.224813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68529021-4877-4227-b753-8a612c99cd39 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-68529021-4877-4227-b753-8a612c99cd39 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:54.242362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:54.243481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:37:54.244370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:54.248699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 451/906] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:54.249638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68529021-4877-4227-b753-8a612c99cd39 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:54.290047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 456/907] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:37:53 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:37:54.291309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581dd89-da39-47c2-8f86-6e683de01575 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:54.303150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:54.358989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68529021-4877-4227-b753-8a612c99cd39 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:54.395671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b80d4-6b18-49b1-a5b8-a8300daa9ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:54.396289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b80d4-6b18-49b1-a5b8-a8300daa9ed0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.396649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b80d4-6b18-49b1-a5b8-a8300daa9ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.397010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b80d4-6b18-49b1-a5b8-a8300daa9ed0 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.398466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b80d4-6b18-49b1-a5b8-a8300daa9ed0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:54.398862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b80d4-6b18-49b1-a5b8-a8300daa9ed0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:54.400410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b80d4-6b18-49b1-a5b8-a8300daa9ed0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:54.400668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581dd89-da39-47c2-8f86-6e683de01575 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:54.410398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 452/908] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:54.411363 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b80d4-6b18-49b1-a5b8-a8300daa9ed0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:54.448040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140e98-a8a4-4ae4-8f4a-a751bee52d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:54.449232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140e98-a8a4-4ae4-8f4a-a751bee52d21 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.449686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:54.449958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140e98-a8a4-4ae4-8f4a-a751bee52d21 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.450466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc140e98-a8a4-4ae4-8f4a-a751bee52d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.462554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc140e98-a8a4-4ae4-8f4a-a751bee52d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:54.464429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc140e98-a8a4-4ae4-8f4a-a751bee52d21 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-dc140e98-a8a4-4ae4-8f4a-a751bee52d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:54.484034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:54.485012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:54.485917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:54.485917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:54.485917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:54.485917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:54.487889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 457/909] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:54.496513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140e98-a8a4-4ae4-8f4a-a751bee52d21 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:54.532677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b80d4-6b18-49b1-a5b8-a8300daa9ed0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:54.567436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:54.570626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b3797-a133-4e84-8740-fe4863ac68ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:54.571293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3797-a133-4e84-8740-fe4863ac68ec None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.571742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3797-a133-4e84-8740-fe4863ac68ec None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.572016 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b3797-a133-4e84-8740-fe4863ac68ec None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.572733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b3797-a133-4e84-8740-fe4863ac68ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:54.573049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b3797-a133-4e84-8740-fe4863ac68ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:54.574477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b3797-a133-4e84-8740-fe4863ac68ec None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:54.586202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 453/910] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jun 23 10:37:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:54.587297 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b3797-a133-4e84-8740-fe4863ac68ec None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:54.613966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc140e98-a8a4-4ae4-8f4a-a751bee52d21 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:54.652215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179746ed-c3ed-4120-a6c0-c3a48bbb9506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:54.653265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179746ed-c3ed-4120-a6c0-c3a48bbb9506 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.653823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179746ed-c3ed-4120-a6c0-c3a48bbb9506 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.654453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179746ed-c3ed-4120-a6c0-c3a48bbb9506 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.655391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179746ed-c3ed-4120-a6c0-c3a48bbb9506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:54.655901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179746ed-c3ed-4120-a6c0-c3a48bbb9506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:54.657727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179746ed-c3ed-4120-a6c0-c3a48bbb9506 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:54.675676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 458/911] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:37:54.676985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179746ed-c3ed-4120-a6c0-c3a48bbb9506 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:54.691110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:54.701652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b3797-a133-4e84-8740-fe4863ac68ec None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:54.740908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e8660-cddf-4a3f-8af8-fe2a2732de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:54.741603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8660-cddf-4a3f-8af8-fe2a2732de32 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.741891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8660-cddf-4a3f-8af8-fe2a2732de32 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.742174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e8660-cddf-4a3f-8af8-fe2a2732de32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.742959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8660-cddf-4a3f-8af8-fe2a2732de32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:54.744330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e8660-cddf-4a3f-8af8-fe2a2732de32 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:54.778896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 454/912] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 23 10:37:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:54.780583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553e44-ef7a-4ff9-bb10-ca3734938320 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.780880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553e44-ef7a-4ff9-bb10-ca3734938320 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.781164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553e44-ef7a-4ff9-bb10-ca3734938320 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.786919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 455/913] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:54.790151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f1b82-076c-46b9-b540-61b70a79698b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.790610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f1b82-076c-46b9-b540-61b70a79698b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.790900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f1b82-076c-46b9-b540-61b70a79698b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.799827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179746ed-c3ed-4120-a6c0-c3a48bbb9506 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:54.838733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:54.841848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-555f1b82-076c-46b9-b540-61b70a79698b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:54.846223 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-555f1b82-076c-46b9-b540-61b70a79698b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:54.856056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd36842-253e-440a-a40d-96b934628453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:54.857298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd36842-253e-440a-a40d-96b934628453 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.857798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd36842-253e-440a-a40d-96b934628453 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.858274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd36842-253e-440a-a40d-96b934628453 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.869738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd36842-253e-440a-a40d-96b934628453 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:54.871274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd36842-253e-440a-a40d-96b934628453 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-2bd36842-253e-440a-a40d-96b934628453 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:54.888997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:54.890092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:54.891471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:54.891471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:54.891471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:54.891471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:54.891471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:54.891471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:54.891471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:54.891471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:54.895562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 459/914] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:54.897068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550031d7-01cc-484c-b388-dd0d1e2c03a1 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.897357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550031d7-01cc-484c-b388-dd0d1e2c03a1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.897686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550031d7-01cc-484c-b388-dd0d1e2c03a1 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.900037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 460/915] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:54.900828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550031d7-01cc-484c-b388-dd0d1e2c03a1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:54.950785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 456/916] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:54.951842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8c88-5f12-49ce-bd9e-690ae60d5a2c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:54.952132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8c88-5f12-49ce-bd9e-690ae60d5a2c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:54.952411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8c88-5f12-49ce-bd9e-690ae60d5a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:54.972734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-53ef8c88-5f12-49ce-bd9e-690ae60d5a2c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:54.974209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-53ef8c88-5f12-49ce-bd9e-690ae60d5a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:55.043747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550031d7-01cc-484c-b388-dd0d1e2c03a1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:55.074660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 457/917] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:55.075744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8c88-5f12-49ce-bd9e-690ae60d5a2c None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:55.084915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26729e5-da80-4667-8bb1-90853d8fdb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:55.086303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26729e5-da80-4667-8bb1-90853d8fdb2d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:55.086683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26729e5-da80-4667-8bb1-90853d8fdb2d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:55.086969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26729e5-da80-4667-8bb1-90853d8fdb2d None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:55.087871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26729e5-da80-4667-8bb1-90853d8fdb2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:55.088185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26729e5-da80-4667-8bb1-90853d8fdb2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:55.089680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26729e5-da80-4667-8bb1-90853d8fdb2d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:55.090968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:55.105972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 461/918] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:55.107137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26729e5-da80-4667-8bb1-90853d8fdb2d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:55.163833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:55.202860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8c88-5f12-49ce-bd9e-690ae60d5a2c None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:55.235274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26729e5-da80-4667-8bb1-90853d8fdb2d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:55.243206 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881391d4-b920-4029-8050-251ba3311fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:55.244102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881391d4-b920-4029-8050-251ba3311fe0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:55.244286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881391d4-b920-4029-8050-251ba3311fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:55.244569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881391d4-b920-4029-8050-251ba3311fe0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:55.245229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881391d4-b920-4029-8050-251ba3311fe0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:55.246662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881391d4-b920-4029-8050-251ba3311fe0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-881391d4-b920-4029-8050-251ba3311fe0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:55.259361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:55.260347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:55.261189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 458/919] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jun 23 10:37:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:55.262071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881391d4-b920-4029-8050-251ba3311fe0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:55.279968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bf5b3-583f-41f4-b3ff-721071e35f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:55.280627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bf5b3-583f-41f4-b3ff-721071e35f47 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:55.280907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bf5b3-583f-41f4-b3ff-721071e35f47 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:55.281178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bf5b3-583f-41f4-b3ff-721071e35f47 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:55.281900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bf5b3-583f-41f4-b3ff-721071e35f47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:55.283301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bf5b3-583f-41f4-b3ff-721071e35f47 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:55.297483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 462/920] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:37:55 2022] POST /identity/v3/services => generated 241 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:55.298196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bf5b3-583f-41f4-b3ff-721071e35f47 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:55.361169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:55.400834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881391d4-b920-4029-8050-251ba3311fe0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:55.439479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:55.448769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b2777-4ba5-4760-90b7-ddb0a77c3c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:55.449161 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b2777-4ba5-4760-90b7-ddb0a77c3c30 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:55.449460 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b2777-4ba5-4760-90b7-ddb0a77c3c30 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:55.449740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b2777-4ba5-4760-90b7-ddb0a77c3c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:55.450704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b2777-4ba5-4760-90b7-ddb0a77c3c30 None admin] RBAC: Adding query filter params (role.id=74701f1be94d436688021bce42948949, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=8dcf5fbe26e44d858d5a2f708cd28c63) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:55.451020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b2777-4ba5-4760-90b7-ddb0a77c3c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:55.452781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b2777-4ba5-4760-90b7-ddb0a77c3c30 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:55.454442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bf5b3-583f-41f4-b3ff-721071e35f47 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:55.466532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 459/921] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:37:55 2022] GET /identity/v3/role_assignments?user.id=8dcf5fbe26e44d858d5a2f708cd28c63&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=74701f1be94d436688021bce42948949 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:55.496782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3a574-23ed-48b2-bd38-e31b12d511d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:55.497818 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3a574-23ed-48b2-bd38-e31b12d511d2 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:55.498288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3a574-23ed-48b2-bd38-e31b12d511d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:55.498781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3a574-23ed-48b2-bd38-e31b12d511d2 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:55.499706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3a574-23ed-48b2-bd38-e31b12d511d2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:55.500203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3a574-23ed-48b2-bd38-e31b12d511d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:55.501776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3a574-23ed-48b2-bd38-e31b12d511d2 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:55.508611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 463/922] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:37:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:55.516081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b2777-4ba5-4760-90b7-ddb0a77c3c30 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:55.644858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b2777-4ba5-4760-90b7-ddb0a77c3c30 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:55.698655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:55.708864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7c1cb-b58c-4381-a1d1-6c70b438e253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:55.709927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7c1cb-b58c-4381-a1d1-6c70b438e253 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:55.711030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7c1cb-b58c-4381-a1d1-6c70b438e253 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:55.711539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7c1cb-b58c-4381-a1d1-6c70b438e253 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:55.712866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7c1cb-b58c-4381-a1d1-6c70b438e253 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:55.713424 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7c1cb-b58c-4381-a1d1-6c70b438e253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:55.716052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7c1cb-b58c-4381-a1d1-6c70b438e253 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:55.725714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 460/923] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:37:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:55.731804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3a574-23ed-48b2-bd38-e31b12d511d2 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:55.839513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3a574-23ed-48b2-bd38-e31b12d511d2 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:55.876898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dc225-74df-4c7e-a68a-8e0fbfb3fc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:55.877908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dc225-74df-4c7e-a68a-8e0fbfb3fc19 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:55.878508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dc225-74df-4c7e-a68a-8e0fbfb3fc19 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:55.878995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dc225-74df-4c7e-a68a-8e0fbfb3fc19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:55.879958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dc225-74df-4c7e-a68a-8e0fbfb3fc19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:55.881544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dc225-74df-4c7e-a68a-8e0fbfb3fc19 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:55.907240 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 464/924] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 23 10:37:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:37:57.069343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ead503-1208-4c4a-b565-5720829867b6 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.070416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ead503-1208-4c4a-b565-5720829867b6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.070707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ead503-1208-4c4a-b565-5720829867b6 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.072346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 461/925] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:57.077754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e7d0a-46b1-4493-8797-d104edf60cf7 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.078157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e7d0a-46b1-4493-8797-d104edf60cf7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.078354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e7d0a-46b1-4493-8797-d104edf60cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.095683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d15e7d0a-46b1-4493-8797-d104edf60cf7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:57.096869 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d15e7d0a-46b1-4493-8797-d104edf60cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:57.106492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:57.180186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 465/926] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:57.203363 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ead503-1208-4c4a-b565-5720829867b6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:57.312198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ead503-1208-4c4a-b565-5720829867b6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:57.346457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:57.347090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.347373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.347646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.348406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:57.349908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:57.351913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WARNING keystone.server.flask.common [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 10:37:57.371963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.sql.core [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 10:37:57.371963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 10:37:57.371963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [parameters: {'id': 'c1aea7fb124a47c4b2b23a885e360f6b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 10:37:57.371963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91931) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1aea7fb124a47c4b2b23a885e360f6b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1aea7fb124a47c4b2b23a885e360f6b. Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:37:57.379750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result.read() Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 10:37:57.380599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application yield resource Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise self.value Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application session.commit() Jun 23 10:37:57.381589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.session.flush() Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application compat.raise_( Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 10:37:57.383462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 10:37:57.385686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result.read() Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:37:57.389866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [parameters: {'id': 'c1aea7fb124a47c4b2b23a885e360f6b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:57.391967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:57.393890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c1aea7fb124a47c4b2b23a885e360f6b. Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:57.395390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 462/927] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jun 23 10:37:57 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:57.396102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e7d0a-46b1-4493-8797-d104edf60cf7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:57.513091 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e7d0a-46b1-4493-8797-d104edf60cf7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:57.552338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8588815-5f62-4a61-be02-cc59d1cafeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:57.554291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8588815-5f62-4a61-be02-cc59d1cafeef None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.554291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8588815-5f62-4a61-be02-cc59d1cafeef None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.554291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8588815-5f62-4a61-be02-cc59d1cafeef None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.561464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8588815-5f62-4a61-be02-cc59d1cafeef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:57.563151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8588815-5f62-4a61-be02-cc59d1cafeef None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:57.566210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-f8588815-5f62-4a61-be02-cc59d1cafeef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:37:57.579031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:57.580183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:57.581333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:37:57.581333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:37:57.581333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:37:57.581333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:37:57.581333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:37:57.581333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:37:57.581333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:37:57.581333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:57.583501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 466/928] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:57.590473 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:57.629714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7018f4-dc16-4b3d-8d3f-177019df471c None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.629922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7018f4-dc16-4b3d-8d3f-177019df471c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.630205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7018f4-dc16-4b3d-8d3f-177019df471c None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.631848 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 467/929] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:57.637641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cfa37-5077-4396-881a-2bec9425ac77 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.637930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cfa37-5077-4396-881a-2bec9425ac77 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.638210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cfa37-5077-4396-881a-2bec9425ac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.646823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:57.658757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-9b7cfa37-5077-4396-881a-2bec9425ac77 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:57.660472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9b7cfa37-5077-4396-881a-2bec9425ac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:57.710219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f925d6-03fa-409b-b1fc-1eb9d615d12a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:57.750547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49559b-e44a-4cf1-800d-fa8c7ed7f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:57.751212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49559b-e44a-4cf1-800d-fa8c7ed7f5b0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.751498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49559b-e44a-4cf1-800d-fa8c7ed7f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.751775 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49559b-e44a-4cf1-800d-fa8c7ed7f5b0 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.752530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49559b-e44a-4cf1-800d-fa8c7ed7f5b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:57.752851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49559b-e44a-4cf1-800d-fa8c7ed7f5b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:57.754561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49559b-e44a-4cf1-800d-fa8c7ed7f5b0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:57.755600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 468/930] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:37:57.776661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 463/931] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:37:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:57.779457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cfa37-5077-4396-881a-2bec9425ac77 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:57.870543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bf927-7e37-4f42-88fb-2e31d0536f00 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.870829 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bf927-7e37-4f42-88fb-2e31d0536f00 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.871113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bf927-7e37-4f42-88fb-2e31d0536f00 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.876605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 464/932] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:57.878490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72493245-f4ec-42b6-aa2a-b3bf0b9c9b71 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.878782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72493245-f4ec-42b6-aa2a-b3bf0b9c9b71 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.879064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72493245-f4ec-42b6-aa2a-b3bf0b9c9b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.899427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-72493245-f4ec-42b6-aa2a-b3bf0b9c9b71 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:57.900917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-72493245-f4ec-42b6-aa2a-b3bf0b9c9b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:57.902030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cfa37-5077-4396-881a-2bec9425ac77 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:57.932781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:57.941390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755fe86-938a-4754-ae2b-e994518d4d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:57.942210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755fe86-938a-4754-ae2b-e994518d4d03 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:57.942519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755fe86-938a-4754-ae2b-e994518d4d03 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:57.942799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755fe86-938a-4754-ae2b-e994518d4d03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:57.943467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755fe86-938a-4754-ae2b-e994518d4d03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:57.945446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755fe86-938a-4754-ae2b-e994518d4d03 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-1755fe86-938a-4754-ae2b-e994518d4d03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:57.965571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:57.966711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:37:57.967604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:57.971321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 469/933] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:37:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:57.978100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755fe86-938a-4754-ae2b-e994518d4d03 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.003150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 465/934] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:37:58.026300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72493245-f4ec-42b6-aa2a-b3bf0b9c9b71 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.079863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:58.099699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755fe86-938a-4754-ae2b-e994518d4d03 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.139730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5af047-8dd3-4cb9-87ce-51b1fca259c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.140387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af047-8dd3-4cb9-87ce-51b1fca259c0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.140787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af047-8dd3-4cb9-87ce-51b1fca259c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.141068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5af047-8dd3-4cb9-87ce-51b1fca259c0 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.141767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af047-8dd3-4cb9-87ce-51b1fca259c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:58.142071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af047-8dd3-4cb9-87ce-51b1fca259c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:58.143594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5af047-8dd3-4cb9-87ce-51b1fca259c0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:58.151448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 470/935] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:37:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:58.152465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2948ce-b55a-4757-aedf-4664a6672de2 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.152753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2948ce-b55a-4757-aedf-4664a6672de2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.153033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2948ce-b55a-4757-aedf-4664a6672de2 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.154465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 471/936] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:37:58.158452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72493245-f4ec-42b6-aa2a-b3bf0b9c9b71 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.159456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96304a1-b92c-4d25-afd2-1f9d7918563a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.159742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96304a1-b92c-4d25-afd2-1f9d7918563a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.160139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96304a1-b92c-4d25-afd2-1f9d7918563a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.177860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d96304a1-b92c-4d25-afd2-1f9d7918563a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:37:58.179315 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d96304a1-b92c-4d25-afd2-1f9d7918563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:37:58.195568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64847-cea7-4b20-baea-9052ab5de3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.196381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64847-cea7-4b20-baea-9052ab5de3d4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.196666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64847-cea7-4b20-baea-9052ab5de3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.196944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64847-cea7-4b20-baea-9052ab5de3d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.207245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e64847-cea7-4b20-baea-9052ab5de3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-75e64847-cea7-4b20-baea-9052ab5de3d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:37:58.215900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:58.216870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:37:58.217736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:58.221926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 466/937] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:37:58.222941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64847-cea7-4b20-baea-9052ab5de3d4 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.239842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:58.255201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 472/938] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:37:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:37:58.256310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96304a1-b92c-4d25-afd2-1f9d7918563a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.342401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:58.346599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64847-cea7-4b20-baea-9052ab5de3d4 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.360754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96304a1-b92c-4d25-afd2-1f9d7918563a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.382935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070bf3d-a9d2-4555-b437-fb02deeab3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.383609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070bf3d-a9d2-4555-b437-fb02deeab3c7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.383897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070bf3d-a9d2-4555-b437-fb02deeab3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.384177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070bf3d-a9d2-4555-b437-fb02deeab3c7 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.384884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070bf3d-a9d2-4555-b437-fb02deeab3c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:58.385196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070bf3d-a9d2-4555-b437-fb02deeab3c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:58.386604 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070bf3d-a9d2-4555-b437-fb02deeab3c7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:58.391677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 467/939] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:58.392457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070bf3d-a9d2-4555-b437-fb02deeab3c7 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.408176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f91a0-4ccd-4e17-a6a5-401ce6e382fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.408794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f91a0-4ccd-4e17-a6a5-401ce6e382fd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.409082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f91a0-4ccd-4e17-a6a5-401ce6e382fd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.409363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f91a0-4ccd-4e17-a6a5-401ce6e382fd None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.410182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f91a0-4ccd-4e17-a6a5-401ce6e382fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:58.410470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f91a0-4ccd-4e17-a6a5-401ce6e382fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:58.411846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f91a0-4ccd-4e17-a6a5-401ce6e382fd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:58.421746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 473/940] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:58.422603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f91a0-4ccd-4e17-a6a5-401ce6e382fd None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.474632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:58.506567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070bf3d-a9d2-4555-b437-fb02deeab3c7 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.533758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f91a0-4ccd-4e17-a6a5-401ce6e382fd None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.551164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2920675-734b-4636-bdef-8c543d7dc256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.552188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920675-734b-4636-bdef-8c543d7dc256 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.552628 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920675-734b-4636-bdef-8c543d7dc256 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.552902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2920675-734b-4636-bdef-8c543d7dc256 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.553552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2920675-734b-4636-bdef-8c543d7dc256 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:58.555390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2920675-734b-4636-bdef-8c543d7dc256 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-d2920675-734b-4636-bdef-8c543d7dc256 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:58.567731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:58.568758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:58.570134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 468/941] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:58.571253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2920675-734b-4636-bdef-8c543d7dc256 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.576222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fffe8-03df-4d97-98bb-8b940adfedf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.576889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fffe8-03df-4d97-98bb-8b940adfedf1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.577169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fffe8-03df-4d97-98bb-8b940adfedf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.577440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fffe8-03df-4d97-98bb-8b940adfedf1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.578236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fffe8-03df-4d97-98bb-8b940adfedf1 None admin] RBAC: Adding query filter params (interface=public, service_id=51b5fa25d04d48c89099a695c8e29358, region_id=RegionOne) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:58.578577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fffe8-03df-4d97-98bb-8b940adfedf1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:58.580004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675fffe8-03df-4d97-98bb-8b940adfedf1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:58.586992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 474/942] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/endpoints?service_id=51b5fa25d04d48c89099a695c8e29358&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:58.587521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fffe8-03df-4d97-98bb-8b940adfedf1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.607654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:58.684413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2920675-734b-4636-bdef-8c543d7dc256 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.699019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fffe8-03df-4d97-98bb-8b940adfedf1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.717710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:58.723401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad709c1-f846-4a03-b2ad-632978ffd768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.724200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad709c1-f846-4a03-b2ad-632978ffd768 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.724484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad709c1-f846-4a03-b2ad-632978ffd768 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.724765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad709c1-f846-4a03-b2ad-632978ffd768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.736821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad709c1-f846-4a03-b2ad-632978ffd768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:58.738270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad709c1-f846-4a03-b2ad-632978ffd768 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:58.742905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d90e0-7cac-499e-9699-6522442891bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.743732 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d90e0-7cac-499e-9699-6522442891bc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.744157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d90e0-7cac-499e-9699-6522442891bc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.744576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d90e0-7cac-499e-9699-6522442891bc None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.745437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d90e0-7cac-499e-9699-6522442891bc None admin] RBAC: Adding query filter params (name=compute) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:58.746281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d90e0-7cac-499e-9699-6522442891bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:58.748195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d90e0-7cac-499e-9699-6522442891bc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:58.753454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 475/943] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:58.754388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d90e0-7cac-499e-9699-6522442891bc None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-7ad709c1-f846-4a03-b2ad-632978ffd768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:58.756455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:58.757504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:58.758579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:58.758579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:58.758579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:58.758579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:37:58.763053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 469/944] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:58.763966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad709c1-f846-4a03-b2ad-632978ffd768 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.848662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:58.873552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad709c1-f846-4a03-b2ad-632978ffd768 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.876368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d90e0-7cac-499e-9699-6522442891bc None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:58.910347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad4d45-778e-4963-b9cc-66bc0f04d3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.911019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad4d45-778e-4963-b9cc-66bc0f04d3eb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.911300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad4d45-778e-4963-b9cc-66bc0f04d3eb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.911577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad4d45-778e-4963-b9cc-66bc0f04d3eb None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.912273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad4d45-778e-4963-b9cc-66bc0f04d3eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:58.912452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee47bb-66ce-4ede-a760-838deca612c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:58.912576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad4d45-778e-4963-b9cc-66bc0f04d3eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:58.913205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee47bb-66ce-4ede-a760-838deca612c8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:58.914378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee47bb-66ce-4ede-a760-838deca612c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:58.914378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee47bb-66ce-4ede-a760-838deca612c8 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:58.914682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad4d45-778e-4963-b9cc-66bc0f04d3eb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:58.915024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee47bb-66ce-4ede-a760-838deca612c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:58.916372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee47bb-66ce-4ede-a760-838deca612c8 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:58.930724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 470/945] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:58.930724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad4d45-778e-4963-b9cc-66bc0f04d3eb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:58.935028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 476/946] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:37:59.066821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad4d45-778e-4963-b9cc-66bc0f04d3eb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:59.115703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910f265-c341-4f24-846f-ab8244dcd686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:59.117858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910f265-c341-4f24-846f-ab8244dcd686 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:59.118396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910f265-c341-4f24-846f-ab8244dcd686 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:59.118612 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910f265-c341-4f24-846f-ab8244dcd686 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:59.119356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910f265-c341-4f24-846f-ab8244dcd686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:59.119673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910f265-c341-4f24-846f-ab8244dcd686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:59.121076 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910f265-c341-4f24-846f-ab8244dcd686 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:59.149380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 471/947] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:59.155442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee47bb-66ce-4ede-a760-838deca612c8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:59.209507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:59.270477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee47bb-66ce-4ede-a760-838deca612c8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:59.308307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f3be3-03c0-406f-9965-349f04e85f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:59.309128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f3be3-03c0-406f-9965-349f04e85f43 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:59.309417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f3be3-03c0-406f-9965-349f04e85f43 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:59.309800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f3be3-03c0-406f-9965-349f04e85f43 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:59.318152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f3be3-03c0-406f-9965-349f04e85f43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:59.320247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f3be3-03c0-406f-9965-349f04e85f43 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-332f3be3-03c0-406f-9965-349f04e85f43 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:37:59.336114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:59.337140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:59.338096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 477/948] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:37:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:59.344778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910f265-c341-4f24-846f-ab8244dcd686 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:59.349004 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:59.456231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910f265-c341-4f24-846f-ab8244dcd686 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:59.505204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96c03f-0c2f-42e2-b934-d05b6a6fa443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:59.505802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96c03f-0c2f-42e2-b934-d05b6a6fa443 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:59.506088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96c03f-0c2f-42e2-b934-d05b6a6fa443 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:59.506396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96c03f-0c2f-42e2-b934-d05b6a6fa443 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:59.507851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96c03f-0c2f-42e2-b934-d05b6a6fa443 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:59.508167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96c03f-0c2f-42e2-b934-d05b6a6fa443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:59.509625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96c03f-0c2f-42e2-b934-d05b6a6fa443 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:59.530239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 472/949] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 23 10:37:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:59.535667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f3be3-03c0-406f-9965-349f04e85f43 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:59.649844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f3be3-03c0-406f-9965-349f04e85f43 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:59.651412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:59.694193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951f31f-eaa1-4a08-a2d3-4e40b0e8abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:59.695636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951f31f-eaa1-4a08-a2d3-4e40b0e8abb2 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:59.696159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951f31f-eaa1-4a08-a2d3-4e40b0e8abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:59.696669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951f31f-eaa1-4a08-a2d3-4e40b0e8abb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:59.708706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951f31f-eaa1-4a08-a2d3-4e40b0e8abb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:59.710841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951f31f-eaa1-4a08-a2d3-4e40b0e8abb2 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-2951f31f-eaa1-4a08-a2d3-4e40b0e8abb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:37:59.729880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:37:59.730883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:37:59.731912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:37:59.731912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:37:59.731912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:37:59.731912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:37:59.732566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 478/950] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:37:59.738786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96c03f-0c2f-42e2-b934-d05b6a6fa443 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:37:59.808201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:37:59.849105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96c03f-0c2f-42e2-b934-d05b6a6fa443 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:37:59.885254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f80b3a-ad2e-4258-83f5-333404b2d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:37:59.885929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80b3a-ad2e-4258-83f5-333404b2d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:37:59.886215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80b3a-ad2e-4258-83f5-333404b2d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:37:59.886522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80b3a-ad2e-4258-83f5-333404b2d7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:37:59.887258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80b3a-ad2e-4258-83f5-333404b2d7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:37:59.887569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80b3a-ad2e-4258-83f5-333404b2d7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:37:59.889040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80b3a-ad2e-4258-83f5-333404b2d7e8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:37:59.905729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 473/951] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:37:59.907109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951f31f-eaa1-4a08-a2d3-4e40b0e8abb2 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:00.017217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951f31f-eaa1-4a08-a2d3-4e40b0e8abb2 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:00.052970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2ea4-24e9-4dcc-9a64-47f95f6c4db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:00.053843 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2ea4-24e9-4dcc-9a64-47f95f6c4db6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:00.054754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2ea4-24e9-4dcc-9a64-47f95f6c4db6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:00.055037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2ea4-24e9-4dcc-9a64-47f95f6c4db6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:00.062235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2ea4-24e9-4dcc-9a64-47f95f6c4db6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:00.063725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2ea4-24e9-4dcc-9a64-47f95f6c4db6 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:00.066999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b1538-f351-4d48-a341-080a814a0d9a None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:00.067541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b1538-f351-4d48-a341-080a814a0d9a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:00.068041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b1538-f351-4d48-a341-080a814a0d9a None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:00.070553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 474/952] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:00.075836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaef0a-42f4-4d74-bdcd-bc1f5d60f789 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:00.076359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaef0a-42f4-4d74-bdcd-bc1f5d60f789 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:00.076836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaef0a-42f4-4d74-bdcd-bc1f5d60f789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-a5ad2ea4-24e9-4dcc-9a64-47f95f6c4db6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:38:00.080704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:00.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:00.082798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:38:00.082798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:38:00.082798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:38:00.082798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:38:00.082798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:38:00.082798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:38:00.082798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:00.082798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:00.086414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 479/953] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:00.091302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2ea4-24e9-4dcc-9a64-47f95f6c4db6 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:00.099436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-cbfaef0a-42f4-4d74-bdcd-bc1f5d60f789 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:00.101712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-cbfaef0a-42f4-4d74-bdcd-bc1f5d60f789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:00.113165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:00.180896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 475/954] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:00.208985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaef0a-42f4-4d74-bdcd-bc1f5d60f789 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:00.215208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2ea4-24e9-4dcc-9a64-47f95f6c4db6 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:00.256719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894ded9-5973-4f98-b294-c4cd6961e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:00.258470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894ded9-5973-4f98-b294-c4cd6961e653 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:00.258980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894ded9-5973-4f98-b294-c4cd6961e653 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:00.259453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894ded9-5973-4f98-b294-c4cd6961e653 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:00.260434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894ded9-5973-4f98-b294-c4cd6961e653 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:00.260958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894ded9-5973-4f98-b294-c4cd6961e653 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:00.262668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894ded9-5973-4f98-b294-c4cd6961e653 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:00.280909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 480/955] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:00.282114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894ded9-5973-4f98-b294-c4cd6961e653 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:00.282686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:00.340896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaef0a-42f4-4d74-bdcd-bc1f5d60f789 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:00.372266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:00.391784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:00.392466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:00.393007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:00.393295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:00.394012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:00.396139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:00.401798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894ded9-5973-4f98-b294-c4cd6961e653 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:00.414657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.sql.core [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 10:38:00.414657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 10:38:00.414657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [parameters: {'user_id': '61347dc3d2464e58b65c2202c0498967', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 10:38:00.414657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91931) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result.read() Jun 23 10:38:00.423887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:38:00.424838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application yield resource Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise self.value Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application session.commit() Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 10:38:00.425849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.session.flush() Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application compat.raise_( Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 10:38:00.426800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:38:00.427727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application result.read() Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:38:00.428658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [parameters: {'user_id': '61347dc3d2464e58b65c2202c0498967', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:00.430301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 10:38:00.433249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 10:38:00.435472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 10:38:00.435472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 10:38:00.435472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 10:38:00.435472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 10:38:00.435472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 10:38:00.435472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:00.435472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 476/956] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jun 23 10:38:00 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:00.435472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:00.458883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd4fbe-3fe7-436a-a7b8-2b104e866ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:00.460488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd4fbe-3fe7-436a-a7b8-2b104e866ace None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:00.461242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd4fbe-3fe7-436a-a7b8-2b104e866ace None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:00.461780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd4fbe-3fe7-436a-a7b8-2b104e866ace None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/8dcf5fbe26e44d858d5a2f708cd28c63/roles/74701f1be94d436688021bce42948949` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:00.465103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd4fbe-3fe7-436a-a7b8-2b104e866ace None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=8dcf5fbe26e44d858d5a2f708cd28c63, role_id=74701f1be94d436688021bce42948949)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:00.467112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd4fbe-3fe7-436a-a7b8-2b104e866ace None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:00.490514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 481/957] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:00 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/8dcf5fbe26e44d858d5a2f708cd28c63/roles/74701f1be94d436688021bce42948949 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:38:00.547224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead6d57-de5c-4341-964c-fc7cd7bbc63f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:00.564481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:00.589631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ac23f-128c-4a4f-9150-0830abdfcd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:00.590477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ac23f-128c-4a4f-9150-0830abdfcd53 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:00.590767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ac23f-128c-4a4f-9150-0830abdfcd53 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:00.591100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ac23f-128c-4a4f-9150-0830abdfcd53 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:00.600420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ac23f-128c-4a4f-9150-0830abdfcd53 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:00.602708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ac23f-128c-4a4f-9150-0830abdfcd53 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-b27ac23f-128c-4a4f-9150-0830abdfcd53 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:38:00.619120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:00.620157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:38:00.621130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:00.625327 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 477/958] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:00.626770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd4fbe-3fe7-436a-a7b8-2b104e866ace None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:00.737312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd4fbe-3fe7-436a-a7b8-2b104e866ace None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:00.773121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2ae1d8-f1f2-4556-821e-31b9d6e109f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:00.773984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ae1d8-f1f2-4556-821e-31b9d6e109f1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:00.774269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ae1d8-f1f2-4556-821e-31b9d6e109f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:00.774574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ae1d8-f1f2-4556-821e-31b9d6e109f1 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:00.775393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ae1d8-f1f2-4556-821e-31b9d6e109f1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:00.775702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ae1d8-f1f2-4556-821e-31b9d6e109f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:00.777289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2ae1d8-f1f2-4556-821e-31b9d6e109f1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:00.779997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:00.823947 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 482/959] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jun 23 10:38:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:01.097093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45547c7a-e78c-4c46-894e-4ee8b145b3c9 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:01.099497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45547c7a-e78c-4c46-894e-4ee8b145b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:01.099497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45547c7a-e78c-4c46-894e-4ee8b145b3c9 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:01.102973 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 478/960] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:01.108354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bcfc6-de0b-49bf-9b59-08040ee3e2b6 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:01.108648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bcfc6-de0b-49bf-9b59-08040ee3e2b6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:01.108930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bcfc6-de0b-49bf-9b59-08040ee3e2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:01.126753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a99bcfc6-de0b-49bf-9b59-08040ee3e2b6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:01.127939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a99bcfc6-de0b-49bf-9b59-08040ee3e2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:01.198615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 483/961] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:01.221740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45547c7a-e78c-4c46-894e-4ee8b145b3c9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:01.224913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d1bd-81c6-42e1-bc90-64220b6641bc None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:01.225356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d1bd-81c6-42e1-bc90-64220b6641bc None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:01.225455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d1bd-81c6-42e1-bc90-64220b6641bc None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:01.228147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 484/962] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:01.232633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b550a2f-fb0c-4b4c-ba9f-c784450c61f2 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:01.232920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b550a2f-fb0c-4b4c-ba9f-c784450c61f2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:01.233196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b550a2f-fb0c-4b4c-ba9f-c784450c61f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:01.250904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-7b550a2f-fb0c-4b4c-ba9f-c784450c61f2 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:01.252108 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7b550a2f-fb0c-4b4c-ba9f-c784450c61f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:01.327748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 485/963] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:01.331067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45547c7a-e78c-4c46-894e-4ee8b145b3c9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:01.352315 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b550a2f-fb0c-4b4c-ba9f-c784450c61f2 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:01.368140 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e47ae-129e-403a-b573-7634bc82344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:01.368808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e47ae-129e-403a-b573-7634bc82344f None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:01.369092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e47ae-129e-403a-b573-7634bc82344f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:01.369368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e47ae-129e-403a-b573-7634bc82344f None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:01.370204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e47ae-129e-403a-b573-7634bc82344f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:01.371727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e47ae-129e-403a-b573-7634bc82344f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:01.394353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 479/964] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:38:01 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:01.418574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:01.474617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b550a2f-fb0c-4b4c-ba9f-c784450c61f2 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:01.526669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58790ec-4582-48e1-bd50-d75e617b0971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:01.527492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58790ec-4582-48e1-bd50-d75e617b0971 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:01.527773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58790ec-4582-48e1-bd50-d75e617b0971 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:01.528050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58790ec-4582-48e1-bd50-d75e617b0971 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:01.528719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58790ec-4582-48e1-bd50-d75e617b0971 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:01.530116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58790ec-4582-48e1-bd50-d75e617b0971 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-c58790ec-4582-48e1-bd50-d75e617b0971 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:01.544884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:01.546135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:01.547117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 486/965] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:38:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:01.552139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e47ae-129e-403a-b573-7634bc82344f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:01.592486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:01.674152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e47ae-129e-403a-b573-7634bc82344f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:01.716737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f79a16-6f4c-4fd2-87d4-27365c3461f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:01.717466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f79a16-6f4c-4fd2-87d4-27365c3461f9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:01.717832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f79a16-6f4c-4fd2-87d4-27365c3461f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:01.717947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f79a16-6f4c-4fd2-87d4-27365c3461f9 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:01.718699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f79a16-6f4c-4fd2-87d4-27365c3461f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:01.719009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f79a16-6f4c-4fd2-87d4-27365c3461f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:01.720395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f79a16-6f4c-4fd2-87d4-27365c3461f9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:01.725910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 480/966] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:38:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:01.731962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58790ec-4582-48e1-bd50-d75e617b0971 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:01.841738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58790ec-4582-48e1-bd50-d75e617b0971 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:01.856281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:01.879614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5967-cb37-40a4-ba09-99869d7e6abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:01.880281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5967-cb37-40a4-ba09-99869d7e6abf None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:01.880569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5967-cb37-40a4-ba09-99869d7e6abf None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:01.880851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5967-cb37-40a4-ba09-99869d7e6abf None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:01.881564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5967-cb37-40a4-ba09-99869d7e6abf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:01.881878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5967-cb37-40a4-ba09-99869d7e6abf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:01.883279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5967-cb37-40a4-ba09-99869d7e6abf None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:01.892889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 487/967] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:38:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:01.894156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f79a16-6f4c-4fd2-87d4-27365c3461f9 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:02.002188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:02.006163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f79a16-6f4c-4fd2-87d4-27365c3461f9 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:02.043454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043013ec-dbcb-4f97-9f43-57d2a64030d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:02.044112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043013ec-dbcb-4f97-9f43-57d2a64030d6 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:02.044397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043013ec-dbcb-4f97-9f43-57d2a64030d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:02.044674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043013ec-dbcb-4f97-9f43-57d2a64030d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:02.045427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043013ec-dbcb-4f97-9f43-57d2a64030d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:02.046843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043013ec-dbcb-4f97-9f43-57d2a64030d6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:02.066777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 481/968] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 23 10:38:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:02.738384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf329be-e559-4fa7-be1e-672b51ae41e0 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:02.738929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf329be-e559-4fa7-be1e-672b51ae41e0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:02.738929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf329be-e559-4fa7-be1e-672b51ae41e0 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:02.740319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 488/969] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:02.746258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20718275-9cf7-4d94-986d-a530f3164faf None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:02.746722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20718275-9cf7-4d94-986d-a530f3164faf None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:02.746901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20718275-9cf7-4d94-986d-a530f3164faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:02.764124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-20718275-9cf7-4d94-986d-a530f3164faf None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:02.765653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-20718275-9cf7-4d94-986d-a530f3164faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:02.844131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 482/970] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:02.869435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf329be-e559-4fa7-be1e-672b51ae41e0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:02.974665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf329be-e559-4fa7-be1e-672b51ae41e0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:03.010372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10af7f-d47f-4b54-b9f8-10866a72eb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:03.011187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10af7f-d47f-4b54-b9f8-10866a72eb7a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.011473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10af7f-d47f-4b54-b9f8-10866a72eb7a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.011756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10af7f-d47f-4b54-b9f8-10866a72eb7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.023092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10af7f-d47f-4b54-b9f8-10866a72eb7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-0b10af7f-d47f-4b54-b9f8-10866a72eb7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:03.031246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:03.032205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:38:03.033059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:03.034659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 489/971] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 23 10:38:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:03.038413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20718275-9cf7-4d94-986d-a530f3164faf None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:03.123758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:03.146262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20718275-9cf7-4d94-986d-a530f3164faf None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:03.184588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cd539-3f75-4a4c-b479-2bc106863488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:03.185259 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cd539-3f75-4a4c-b479-2bc106863488 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.185545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cd539-3f75-4a4c-b479-2bc106863488 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.185826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cd539-3f75-4a4c-b479-2bc106863488 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.186698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cd539-3f75-4a4c-b479-2bc106863488 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:03.187099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cd539-3f75-4a4c-b479-2bc106863488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:03.188782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cd539-3f75-4a4c-b479-2bc106863488 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:03.203190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 483/972] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 23 10:38:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:03.205274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10af7f-d47f-4b54-b9f8-10866a72eb7a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:03.244273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:03.312491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10af7f-d47f-4b54-b9f8-10866a72eb7a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:03.346963 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b431631-bf92-4a7f-bd20-7e1e610b4719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:03.347754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b431631-bf92-4a7f-bd20-7e1e610b4719 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.348040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b431631-bf92-4a7f-bd20-7e1e610b4719 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.348321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b431631-bf92-4a7f-bd20-7e1e610b4719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.359814 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b431631-bf92-4a7f-bd20-7e1e610b4719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:03.361269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b431631-bf92-4a7f-bd20-7e1e610b4719 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-3b431631-bf92-4a7f-bd20-7e1e610b4719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:03.379854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:03.380821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:03.386899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:03.386899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:03.386899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:03.386899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:03.386899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 490/973] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:03.389227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cd539-3f75-4a4c-b479-2bc106863488 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:03.481564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31817-3aa6-422f-87ea-8fbe994d6cb1 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.481912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31817-3aa6-422f-87ea-8fbe994d6cb1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.482127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a31817-3aa6-422f-87ea-8fbe994d6cb1 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.483515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 491/974] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:03.488252 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89fe4-cfea-44a7-96cc-c40e2b6906d8 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.488542 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89fe4-cfea-44a7-96cc-c40e2b6906d8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.488824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac89fe4-cfea-44a7-96cc-c40e2b6906d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.500863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cd539-3f75-4a4c-b479-2bc106863488 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:03.507967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0ac89fe4-cfea-44a7-96cc-c40e2b6906d8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:03.509153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0ac89fe4-cfea-44a7-96cc-c40e2b6906d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:03.549549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab05d3-e68a-4ef2-9e7b-814727dbb587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:03.550218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab05d3-e68a-4ef2-9e7b-814727dbb587 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.550567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab05d3-e68a-4ef2-9e7b-814727dbb587 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.550856 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab05d3-e68a-4ef2-9e7b-814727dbb587 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.551591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab05d3-e68a-4ef2-9e7b-814727dbb587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:03.551900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab05d3-e68a-4ef2-9e7b-814727dbb587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:03.553296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab05d3-e68a-4ef2-9e7b-814727dbb587 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:03.572453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 484/975] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:03.573777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab05d3-e68a-4ef2-9e7b-814727dbb587 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:03.576794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:03.589972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 492/976] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:03.613767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac89fe4-cfea-44a7-96cc-c40e2b6906d8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:03.636426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:03.689717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab05d3-e68a-4ef2-9e7b-814727dbb587 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:03.728854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31407aa-1d4d-4c59-ad8a-3deb6b294091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:03.729685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31407aa-1d4d-4c59-ad8a-3deb6b294091 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.729969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31407aa-1d4d-4c59-ad8a-3deb6b294091 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.730250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31407aa-1d4d-4c59-ad8a-3deb6b294091 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.732936 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac89fe4-cfea-44a7-96cc-c40e2b6906d8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:03.738172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31407aa-1d4d-4c59-ad8a-3deb6b294091 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:03.739688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31407aa-1d4d-4c59-ad8a-3deb6b294091 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-d31407aa-1d4d-4c59-ad8a-3deb6b294091 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:38:03.759230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:03.760707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:03.761689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 485/977] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:38:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:03.766030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31407aa-1d4d-4c59-ad8a-3deb6b294091 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:03.779747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbe5de-be7a-425a-9355-4b19a6a0b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:03.780559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbe5de-be7a-425a-9355-4b19a6a0b78d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.780838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbe5de-be7a-425a-9355-4b19a6a0b78d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.781117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfbe5de-be7a-425a-9355-4b19a6a0b78d None admin] PATH_INFO: `/v3/services/compute` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.781782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbe5de-be7a-425a-9355-4b19a6a0b78d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:03.783186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfbe5de-be7a-425a-9355-4b19a6a0b78d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-fbfbe5de-be7a-425a-9355-4b19a6a0b78d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:03.795851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:03.796918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:03.797776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 493/978] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:38:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:03.803140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbe5de-be7a-425a-9355-4b19a6a0b78d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:03.841429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:03.887804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31407aa-1d4d-4c59-ad8a-3deb6b294091 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:03.910698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:03.930288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfbe5de-be7a-425a-9355-4b19a6a0b78d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:03.941841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd17f6-8b1f-4698-b933-fd52e923b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:03.942705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd17f6-8b1f-4698-b933-fd52e923b817 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.942993 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd17f6-8b1f-4698-b933-fd52e923b817 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.943272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd17f6-8b1f-4698-b933-fd52e923b817 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.944123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd17f6-8b1f-4698-b933-fd52e923b817 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:03.944998 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd17f6-8b1f-4698-b933-fd52e923b817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:03.947145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd17f6-8b1f-4698-b933-fd52e923b817 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:03.966381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eb5b2-c73c-4c92-bcbf-e61e77f6f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:03.967276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eb5b2-c73c-4c92-bcbf-e61e77f6f84b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:03.967413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 486/979] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jun 23 10:38:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:03.967503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eb5b2-c73c-4c92-bcbf-e61e77f6f84b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:03.967595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eb5b2-c73c-4c92-bcbf-e61e77f6f84b None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:03.968267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eb5b2-c73c-4c92-bcbf-e61e77f6f84b None admin] RBAC: Adding query filter params (name=compute) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:03.968574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eb5b2-c73c-4c92-bcbf-e61e77f6f84b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:03.970032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eb5b2-c73c-4c92-bcbf-e61e77f6f84b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:03.972758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd17f6-8b1f-4698-b933-fd52e923b817 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:03.975430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 494/980] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:38:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:03.981836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eb5b2-c73c-4c92-bcbf-e61e77f6f84b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.080404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd17f6-8b1f-4698-b933-fd52e923b817 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.092717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eb5b2-c73c-4c92-bcbf-e61e77f6f84b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.104061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:04.121778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80914cb-c9eb-4259-be36-37859e791571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.122466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80914cb-c9eb-4259-be36-37859e791571 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.122753 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80914cb-c9eb-4259-be36-37859e791571 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.123037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80914cb-c9eb-4259-be36-37859e791571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.131205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd2df4-d33e-4745-a805-507cb9600096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.132481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2df4-d33e-4745-a805-507cb9600096 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.132710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2df4-d33e-4745-a805-507cb9600096 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.132985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd2df4-d33e-4745-a805-507cb9600096 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.133703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd2df4-d33e-4745-a805-507cb9600096 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:04.134012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd2df4-d33e-4745-a805-507cb9600096 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.135433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd2df4-d33e-4745-a805-507cb9600096 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.140598 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 495/981] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:38:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:04.146279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd2df4-d33e-4745-a805-507cb9600096 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.158930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:04.202881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80914cb-c9eb-4259-be36-37859e791571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.204343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80914cb-c9eb-4259-be36-37859e791571 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.246282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd2df4-d33e-4745-a805-507cb9600096 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.280439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdc3a8-5859-40d5-8e65-825dd2ceff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.281087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdc3a8-5859-40d5-8e65-825dd2ceff8a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.281369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdc3a8-5859-40d5-8e65-825dd2ceff8a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.281701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdc3a8-5859-40d5-8e65-825dd2ceff8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.282519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdc3a8-5859-40d5-8e65-825dd2ceff8a None admin] RBAC: Adding query filter params (interface=public, service_id=5e8e95206cba40e29943081930fe8a24, region_id=RegionOne) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:04.282828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdc3a8-5859-40d5-8e65-825dd2ceff8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.284191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdc3a8-5859-40d5-8e65-825dd2ceff8a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.289390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 496/982] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/endpoints?service_id=5e8e95206cba40e29943081930fe8a24&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:04.290765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b23a2d-1c26-444b-8f9c-aa94d904ccb3 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.291059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b23a2d-1c26-444b-8f9c-aa94d904ccb3 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.291341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b23a2d-1c26-444b-8f9c-aa94d904ccb3 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.296662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 497/983] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:04.296662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b23a2d-1c26-444b-8f9c-aa94d904ccb3 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.305146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 487/984] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:03 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:38:04.306464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9c286-6944-4e70-b9cb-9f3e29298a41 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.306762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9c286-6944-4e70-b9cb-9f3e29298a41 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.307047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9c286-6944-4e70-b9cb-9f3e29298a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.323278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-66c9c286-6944-4e70-b9cb-9f3e29298a41 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:04.324485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-66c9c286-6944-4e70-b9cb-9f3e29298a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:04.339508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:04.376622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:04.393643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 488/985] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:04.394483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9c286-6944-4e70-b9cb-9f3e29298a41 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.405054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b23a2d-1c26-444b-8f9c-aa94d904ccb3 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.439736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4501f3-7f4a-4741-ac5d-fbf10ff016ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.440670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4501f3-7f4a-4741-ac5d-fbf10ff016ac None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.440959 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4501f3-7f4a-4741-ac5d-fbf10ff016ac None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.441241 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4501f3-7f4a-4741-ac5d-fbf10ff016ac None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.441973 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4501f3-7f4a-4741-ac5d-fbf10ff016ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.443447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4501f3-7f4a-4741-ac5d-fbf10ff016ac None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.449876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 498/986] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:38:04.450718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4501f3-7f4a-4741-ac5d-fbf10ff016ac None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.533430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9c286-6944-4e70-b9cb-9f3e29298a41 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.583454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4501f3-7f4a-4741-ac5d-fbf10ff016ac None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.584404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88634fd0-833a-4682-a788-efd64560931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.585550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88634fd0-833a-4682-a788-efd64560931a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.586189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88634fd0-833a-4682-a788-efd64560931a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.586729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88634fd0-833a-4682-a788-efd64560931a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.600080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88634fd0-833a-4682-a788-efd64560931a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.602429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88634fd0-833a-4682-a788-efd64560931a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.623040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503548b0-ef64-4799-95b1-5b0493d5fc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-88634fd0-833a-4682-a788-efd64560931a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:04.623931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:04.624980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:04.626005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:04.626005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:04.626005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:04.626005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:04.626583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503548b0-ef64-4799-95b1-5b0493d5fc7e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.627030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503548b0-ef64-4799-95b1-5b0493d5fc7e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.627309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503548b0-ef64-4799-95b1-5b0493d5fc7e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.627992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503548b0-ef64-4799-95b1-5b0493d5fc7e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.629375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503548b0-ef64-4799-95b1-5b0493d5fc7e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.630439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 489/987] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:04.631834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88634fd0-833a-4682-a788-efd64560931a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.634956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-503548b0-ef64-4799-95b1-5b0493d5fc7e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:04.644675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:04.645720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:04.646718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 499/988] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:04.651748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503548b0-ef64-4799-95b1-5b0493d5fc7e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.654859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:04.751728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88634fd0-833a-4682-a788-efd64560931a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.765387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503548b0-ef64-4799-95b1-5b0493d5fc7e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.789709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981763-6738-4cf5-9449-e1724ab13b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.790467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981763-6738-4cf5-9449-e1724ab13b74 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.790771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981763-6738-4cf5-9449-e1724ab13b74 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.791086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd981763-6738-4cf5-9449-e1724ab13b74 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.791822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd981763-6738-4cf5-9449-e1724ab13b74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:04.792138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd981763-6738-4cf5-9449-e1724ab13b74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.793519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd981763-6738-4cf5-9449-e1724ab13b74 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.802985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b312-c499-49fc-8d80-e35073fa7c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.803656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b312-c499-49fc-8d80-e35073fa7c47 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.804592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b312-c499-49fc-8d80-e35073fa7c47 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.804831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b312-c499-49fc-8d80-e35073fa7c47 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.805540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b312-c499-49fc-8d80-e35073fa7c47 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:04.805861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b312-c499-49fc-8d80-e35073fa7c47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.807262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b312-c499-49fc-8d80-e35073fa7c47 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.808187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 490/989] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:04.813458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981763-6738-4cf5-9449-e1724ab13b74 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.817423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 500/990] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:04.818364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b312-c499-49fc-8d80-e35073fa7c47 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.880222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:04.886538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:04.924349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd981763-6738-4cf5-9449-e1724ab13b74 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.925560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b312-c499-49fc-8d80-e35073fa7c47 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:04.962145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7a98-9ab6-4f25-9906-f907fdd0fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.962973 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7a98-9ab6-4f25-9906-f907fdd0fdee None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.963266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7a98-9ab6-4f25-9906-f907fdd0fdee None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.963542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce7a98-9ab6-4f25-9906-f907fdd0fdee None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.967987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d74e1b-a9ce-46c1-bafc-25fba1c5db16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:04.969379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d74e1b-a9ce-46c1-bafc-25fba1c5db16 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:04.969802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d74e1b-a9ce-46c1-bafc-25fba1c5db16 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:04.970146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d74e1b-a9ce-46c1-bafc-25fba1c5db16 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:04.970959 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d74e1b-a9ce-46c1-bafc-25fba1c5db16 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:04.971276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d74e1b-a9ce-46c1-bafc-25fba1c5db16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.972830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d74e1b-a9ce-46c1-bafc-25fba1c5db16 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.973337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce7a98-9ab6-4f25-9906-f907fdd0fdee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:04.974835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce7a98-9ab6-4f25-9906-f907fdd0fdee None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:04.979743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 501/991] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:04.985270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d74e1b-a9ce-46c1-bafc-25fba1c5db16 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-4bce7a98-9ab6-4f25-9906-f907fdd0fdee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:38:04.989673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:04.990909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:04.992176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:38:04.992176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:38:04.992176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:38:04.992176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:38:04.992176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:38:04.992176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:38:04.992176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:04.992176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:04.992176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 491/992] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:04.998511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7a98-9ab6-4f25-9906-f907fdd0fdee None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:05.099724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d74e1b-a9ce-46c1-bafc-25fba1c5db16 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:05.108754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce7a98-9ab6-4f25-9906-f907fdd0fdee None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:05.136591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:05.137113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:05.144982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dafed8-1cbd-4046-95cc-24f41ffc03d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:05.145644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dafed8-1cbd-4046-95cc-24f41ffc03d5 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:05.145937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dafed8-1cbd-4046-95cc-24f41ffc03d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:05.146225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dafed8-1cbd-4046-95cc-24f41ffc03d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:05.147115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dafed8-1cbd-4046-95cc-24f41ffc03d5 None admin] RBAC: Adding query filter params (interface=admin, service_id=51b5fa25d04d48c89099a695c8e29358, region_id=RegionOne) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:05.147898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dafed8-1cbd-4046-95cc-24f41ffc03d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:05.149403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dafed8-1cbd-4046-95cc-24f41ffc03d5 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:05.151664 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deefdf-e14f-4022-9429-acf6f036d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:05.152339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deefdf-e14f-4022-9429-acf6f036d36e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:05.152623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deefdf-e14f-4022-9429-acf6f036d36e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:05.152929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deefdf-e14f-4022-9429-acf6f036d36e None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:05.153720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deefdf-e14f-4022-9429-acf6f036d36e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:05.154071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deefdf-e14f-4022-9429-acf6f036d36e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:05.155401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 502/993] 10.222.0.39 () {56 vars in 1249 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/endpoints?service_id=51b5fa25d04d48c89099a695c8e29358&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:05.158715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deefdf-e14f-4022-9429-acf6f036d36e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:05.160614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dafed8-1cbd-4046-95cc-24f41ffc03d5 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:05.173778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 492/994] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:05.179760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deefdf-e14f-4022-9429-acf6f036d36e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:05.275499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dafed8-1cbd-4046-95cc-24f41ffc03d5 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:05.290202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deefdf-e14f-4022-9429-acf6f036d36e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:05.311603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ef611-2423-40b2-b448-0dfddd597b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:05.312269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ef611-2423-40b2-b448-0dfddd597b9b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:05.312556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ef611-2423-40b2-b448-0dfddd597b9b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:05.312836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ef611-2423-40b2-b448-0dfddd597b9b None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:05.313517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ef611-2423-40b2-b448-0dfddd597b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:05.314928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ef611-2423-40b2-b448-0dfddd597b9b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:05.322191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 503/995] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 23 10:38:05 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:38:05.325768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84a60-6e2d-473c-967b-d3b1983cf29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:05.326489 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84a60-6e2d-473c-967b-d3b1983cf29a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:05.326778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84a60-6e2d-473c-967b-d3b1983cf29a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:05.327060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84a60-6e2d-473c-967b-d3b1983cf29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:05.327914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84a60-6e2d-473c-967b-d3b1983cf29a None admin] RBAC: Adding query filter params (role.id=74701f1be94d436688021bce42948949, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=8dcf5fbe26e44d858d5a2f708cd28c63) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:05.328237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84a60-6e2d-473c-967b-d3b1983cf29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:05.329741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84a60-6e2d-473c-967b-d3b1983cf29a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:05.336858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 493/996] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:05 2022] GET /identity/v3/role_assignments?user.id=8dcf5fbe26e44d858d5a2f708cd28c63&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=74701f1be94d436688021bce42948949 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:06.531194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4484c6-aec3-4f93-ab8b-62c60689370a None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:06.531759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4484c6-aec3-4f93-ab8b-62c60689370a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:06.531759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4484c6-aec3-4f93-ab8b-62c60689370a None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:06.533258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 504/997] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:06.539956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3e9c-73c9-43db-ab9c-3eacb1ee3221 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:06.540440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3e9c-73c9-43db-ab9c-3eacb1ee3221 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:06.540547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c3e9c-73c9-43db-ab9c-3eacb1ee3221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:06.557986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a34c3e9c-73c9-43db-ab9c-3eacb1ee3221 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:06.559197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a34c3e9c-73c9-43db-ab9c-3eacb1ee3221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:06.608156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:06.640308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 494/998] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:06.664000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4484c6-aec3-4f93-ab8b-62c60689370a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:06.730178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:06.777746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4484c6-aec3-4f93-ab8b-62c60689370a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:06.820725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e4c55-841d-464c-b20d-1fcce9e8fdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:06.821524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e4c55-841d-464c-b20d-1fcce9e8fdb0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:06.821810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e4c55-841d-464c-b20d-1fcce9e8fdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:06.822091 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e4c55-841d-464c-b20d-1fcce9e8fdb0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:06.822793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e4c55-841d-464c-b20d-1fcce9e8fdb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:06.824164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e4c55-841d-464c-b20d-1fcce9e8fdb0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-1c2e4c55-841d-464c-b20d-1fcce9e8fdb0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:06.836418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:06.837537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:38:06.838465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:06.842403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 505/999] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:38:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:06.843834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3e9c-73c9-43db-ab9c-3eacb1ee3221 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:06.950619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c3e9c-73c9-43db-ab9c-3eacb1ee3221 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:06.987575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dee75-e6fb-4f74-a9a8-9eee4e2285ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:06.988366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dee75-e6fb-4f74-a9a8-9eee4e2285ed None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:06.988654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dee75-e6fb-4f74-a9a8-9eee4e2285ed None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:06.988932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dee75-e6fb-4f74-a9a8-9eee4e2285ed None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:06.989642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dee75-e6fb-4f74-a9a8-9eee4e2285ed None admin] RBAC: Adding query filter params (name=compute) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:06.989951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dee75-e6fb-4f74-a9a8-9eee4e2285ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:06.992606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475dee75-e6fb-4f74-a9a8-9eee4e2285ed None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:07.002372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 495/1000] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:38:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:07.003565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e4c55-841d-464c-b20d-1fcce9e8fdb0 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:07.113811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e4c55-841d-464c-b20d-1fcce9e8fdb0 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:07.138002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:07.151352 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323f383-a890-4659-8a32-63205558e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:07.152074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323f383-a890-4659-8a32-63205558e55f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:07.152360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323f383-a890-4659-8a32-63205558e55f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:07.152689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323f383-a890-4659-8a32-63205558e55f None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:07.153407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323f383-a890-4659-8a32-63205558e55f None admin] RBAC: Adding query filter params (type=compute) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:07.153718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323f383-a890-4659-8a32-63205558e55f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:07.155117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323f383-a890-4659-8a32-63205558e55f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:07.165453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 506/1001] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jun 23 10:38:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:07.166442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dee75-e6fb-4f74-a9a8-9eee4e2285ed None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:07.212017 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:07.276642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dee75-e6fb-4f74-a9a8-9eee4e2285ed None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:07.313609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22dd4e-5f9c-4743-971c-d178cce0df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:07.314276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22dd4e-5f9c-4743-971c-d178cce0df76 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:07.314592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22dd4e-5f9c-4743-971c-d178cce0df76 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:07.314872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22dd4e-5f9c-4743-971c-d178cce0df76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:07.315888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22dd4e-5f9c-4743-971c-d178cce0df76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:07.317261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22dd4e-5f9c-4743-971c-d178cce0df76 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:07.346350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 496/1002] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 23 10:38:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:07.445773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f758764-c0ee-4644-9442-5e91a875bfd4 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:07.445956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f758764-c0ee-4644-9442-5e91a875bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:07.446244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f758764-c0ee-4644-9442-5e91a875bfd4 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:07.447941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 507/1003] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:07.453497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b8a0-3670-4727-8c29-12953c156fd6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:07.453816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b8a0-3670-4727-8c29-12953c156fd6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:07.454060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965b8a0-3670-4727-8c29-12953c156fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:07.472069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a965b8a0-3670-4727-8c29-12953c156fd6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:07.473293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a965b8a0-3670-4727-8c29-12953c156fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:07.555990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 497/1004] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:07 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:07.579063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f758764-c0ee-4644-9442-5e91a875bfd4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:07.588493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217298-89b1-4b36-8f24-a1cd1944e307 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:07.588785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217298-89b1-4b36-8f24-a1cd1944e307 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:07.589069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217298-89b1-4b36-8f24-a1cd1944e307 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:07.590484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 498/1005] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:07.595526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61464b-d70d-4132-beff-19754ad8fd6f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:07.595814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61464b-d70d-4132-beff-19754ad8fd6f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:07.596090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61464b-d70d-4132-beff-19754ad8fd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:07.613155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ac61464b-d70d-4132-beff-19754ad8fd6f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:07.614399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ac61464b-d70d-4132-beff-19754ad8fd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:07.635305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:07.693645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 499/1006] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:07 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:07.695626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f758764-c0ee-4644-9442-5e91a875bfd4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:07.715793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61464b-d70d-4132-beff-19754ad8fd6f None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:07.734461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe911-d458-4b78-b1b4-9079167010cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:07.735593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe911-d458-4b78-b1b4-9079167010cf None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:07.736074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe911-d458-4b78-b1b4-9079167010cf None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:07.736556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe911-d458-4b78-b1b4-9079167010cf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:07.737514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fe911-d458-4b78-b1b4-9079167010cf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:07.739101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fe911-d458-4b78-b1b4-9079167010cf None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-ea3fe911-d458-4b78-b1b4-9079167010cf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:07.753794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:07.754946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:38:07.755812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:07.761502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 508/1007] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jun 23 10:38:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:07.762049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe911-d458-4b78-b1b4-9079167010cf None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:07.816262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:07.829537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61464b-d70d-4132-beff-19754ad8fd6f None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:07.868083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82d51-be4c-4f50-8cf6-6d6227764c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:07.869329 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82d51-be4c-4f50-8cf6-6d6227764c71 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:07.869811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82d51-be4c-4f50-8cf6-6d6227764c71 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:07.870289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b82d51-be4c-4f50-8cf6-6d6227764c71 None admin] PATH_INFO: `/v3/services/image` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:07.871386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82d51-be4c-4f50-8cf6-6d6227764c71 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:07.873623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b82d51-be4c-4f50-8cf6-6d6227764c71 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:07.877246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe911-d458-4b78-b1b4-9079167010cf None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-19b82d51-be4c-4f50-8cf6-6d6227764c71 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:07.893056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:07.895025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:38:07.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:07.902212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 500/1008] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 23 10:38:07 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:07.903438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82d51-be4c-4f50-8cf6-6d6227764c71 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:07.924367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:07.926796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ebfd4-4961-4fd4-ae3d-0ded3ffe5d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:07.927513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ebfd4-4961-4fd4-ae3d-0ded3ffe5d1e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:07.927803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ebfd4-4961-4fd4-ae3d-0ded3ffe5d1e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:07.928090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ebfd4-4961-4fd4-ae3d-0ded3ffe5d1e None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:07.928831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ebfd4-4961-4fd4-ae3d-0ded3ffe5d1e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:07.929214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ebfd4-4961-4fd4-ae3d-0ded3ffe5d1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:07.930639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ebfd4-4961-4fd4-ae3d-0ded3ffe5d1e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:07.936071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 509/1009] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:38:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:07.941834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ebfd4-4961-4fd4-ae3d-0ded3ffe5d1e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:08.018492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b82d51-be4c-4f50-8cf6-6d6227764c71 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:08.049482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ebfd4-4961-4fd4-ae3d-0ded3ffe5d1e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:08.055890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cf370-519d-451d-85b4-5bd04ddfdbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:08.056989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cf370-519d-451d-85b4-5bd04ddfdbff None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:08.057283 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cf370-519d-451d-85b4-5bd04ddfdbff None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:08.057569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cf370-519d-451d-85b4-5bd04ddfdbff None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:08.058281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cf370-519d-451d-85b4-5bd04ddfdbff None admin] RBAC: Adding query filter params (name=image) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:08.059003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cf370-519d-451d-85b4-5bd04ddfdbff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:08.060819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cf370-519d-451d-85b4-5bd04ddfdbff None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:08.064289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:08.066350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 501/1010] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:08.073910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cf370-519d-451d-85b4-5bd04ddfdbff None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:08.092750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afaf91-b26c-4450-9fad-8190a5447f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:08.093416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afaf91-b26c-4450-9fad-8190a5447f06 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:08.093702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afaf91-b26c-4450-9fad-8190a5447f06 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:08.093983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afaf91-b26c-4450-9fad-8190a5447f06 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:08.094733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afaf91-b26c-4450-9fad-8190a5447f06 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:08.095044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afaf91-b26c-4450-9fad-8190a5447f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:08.096410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afaf91-b26c-4450-9fad-8190a5447f06 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:08.102255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 510/1011] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jun 23 10:38:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:08.108168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afaf91-b26c-4450-9fad-8190a5447f06 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:08.172457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:08.193288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cf370-519d-451d-85b4-5bd04ddfdbff None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:08.219809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afaf91-b26c-4450-9fad-8190a5447f06 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:08.229962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c3a89-d66d-4654-80da-501738f8eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:08.230665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3a89-d66d-4654-80da-501738f8eddc None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:08.230958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3a89-d66d-4654-80da-501738f8eddc None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:08.231246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c3a89-d66d-4654-80da-501738f8eddc None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:08.231953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c3a89-d66d-4654-80da-501738f8eddc None admin] RBAC: Adding query filter params (type=image) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:08.232266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c3a89-d66d-4654-80da-501738f8eddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:08.233654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c3a89-d66d-4654-80da-501738f8eddc None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:08.238802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 502/1012] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:08.256034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ce522-34be-4e6d-9ad8-88920b7679e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:08.256722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ce522-34be-4e6d-9ad8-88920b7679e2 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:08.257676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ce522-34be-4e6d-9ad8-88920b7679e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:08.257966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ce522-34be-4e6d-9ad8-88920b7679e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:08.258821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ce522-34be-4e6d-9ad8-88920b7679e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:08.260239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ce522-34be-4e6d-9ad8-88920b7679e2 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:08.279079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 511/1013] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 23 10:38:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:09.512311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1e976-444e-4d4f-b6dc-1269b96e85d5 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:09.512889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1e976-444e-4d4f-b6dc-1269b96e85d5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:09.512889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1e976-444e-4d4f-b6dc-1269b96e85d5 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:09.514279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 503/1014] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:09.521459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d632a2-0ad0-41e5-9ade-d36631d3ef3d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:09.521935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d632a2-0ad0-41e5-9ade-d36631d3ef3d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:09.522035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d632a2-0ad0-41e5-9ade-d36631d3ef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:09.545054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-06d632a2-0ad0-41e5-9ade-d36631d3ef3d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:09.546267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-06d632a2-0ad0-41e5-9ade-d36631d3ef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:09.579550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:09.634355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 512/1015] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:09 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:09.657523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1e976-444e-4d4f-b6dc-1269b96e85d5 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:09.774267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1e976-444e-4d4f-b6dc-1269b96e85d5 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:09.816413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5684a9-b018-43b4-bed9-f7b22e3ee2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:09.817236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5684a9-b018-43b4-bed9-f7b22e3ee2fa None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:09.817515 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5684a9-b018-43b4-bed9-f7b22e3ee2fa None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:09.817792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5684a9-b018-43b4-bed9-f7b22e3ee2fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:09.829481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5684a9-b018-43b4-bed9-f7b22e3ee2fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-4f5684a9-b018-43b4-bed9-f7b22e3ee2fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:09.838196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:09.839253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:09.844997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 504/1016] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 23 10:38:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:09.847303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d632a2-0ad0-41e5-9ade-d36631d3ef3d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:09.971259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d632a2-0ad0-41e5-9ade-d36631d3ef3d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:10.011246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20391472-4966-4ce7-9d4e-d9dbaaec97d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:10.011922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20391472-4966-4ce7-9d4e-d9dbaaec97d5 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.012201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20391472-4966-4ce7-9d4e-d9dbaaec97d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.012477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20391472-4966-4ce7-9d4e-d9dbaaec97d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.013243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20391472-4966-4ce7-9d4e-d9dbaaec97d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:10.013548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20391472-4966-4ce7-9d4e-d9dbaaec97d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:10.014971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20391472-4966-4ce7-9d4e-d9dbaaec97d5 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:10.031524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 513/1017] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 23 10:38:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:10.033299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5684a9-b018-43b4-bed9-f7b22e3ee2fa None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:10.037320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:10.162747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5684a9-b018-43b4-bed9-f7b22e3ee2fa None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:10.203362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5d598-49ba-4365-89e3-1a18cad9f1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:10.204167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d598-49ba-4365-89e3-1a18cad9f1e6 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.204445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d598-49ba-4365-89e3-1a18cad9f1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.204720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5d598-49ba-4365-89e3-1a18cad9f1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.216340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5d598-49ba-4365-89e3-1a18cad9f1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:10.217833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5d598-49ba-4365-89e3-1a18cad9f1e6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-fae5d598-49ba-4365-89e3-1a18cad9f1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:10.237913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:10.239125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:10.246583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:10.246583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:10.246583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:10.246583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:10.246583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 505/1018] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:10.246904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20391472-4966-4ce7-9d4e-d9dbaaec97d5 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:10.281356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:10.356220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73490167-3761-4b34-aad5-dcd95d91ee70 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.356500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73490167-3761-4b34-aad5-dcd95d91ee70 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.356778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73490167-3761-4b34-aad5-dcd95d91ee70 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.358163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 506/1019] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:10.363538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4bcd3-1543-4f23-a90e-ef6d90c7f4c5 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.363822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4bcd3-1543-4f23-a90e-ef6d90c7f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.364097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4bcd3-1543-4f23-a90e-ef6d90c7f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.365337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20391472-4966-4ce7-9d4e-d9dbaaec97d5 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:10.389250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b4f4bcd3-1543-4f23-a90e-ef6d90c7f4c5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:10.390492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b4f4bcd3-1543-4f23-a90e-ef6d90c7f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:10.409668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8947c-e531-4af6-a657-f60abc903bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:10.410621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8947c-e531-4af6-a657-f60abc903bb1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.411049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8947c-e531-4af6-a657-f60abc903bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.411496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8947c-e531-4af6-a657-f60abc903bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.412366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8947c-e531-4af6-a657-f60abc903bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:10.412830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8947c-e531-4af6-a657-f60abc903bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:10.414648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8947c-e531-4af6-a657-f60abc903bb1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:10.431647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 514/1020] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:10.433324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6a6f-dca3-4eaf-800e-09c578a7f3a1 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.433673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6a6f-dca3-4eaf-800e-09c578a7f3a1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.433954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c6a6f-dca3-4eaf-800e-09c578a7f3a1 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.435391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 515/1021] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:10.439706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6a6f-dca3-4eaf-800e-09c578a7f3a1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:10.450659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:10.468797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 507/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:10 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:10.470121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52e75-621e-4eaf-9ce1-c4383ca739c4 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.470439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52e75-621e-4eaf-9ce1-c4383ca739c4 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.470717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52e75-621e-4eaf-9ce1-c4383ca739c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.489228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-93c52e75-621e-4eaf-9ce1-c4383ca739c4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:10.490462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-93c52e75-621e-4eaf-9ce1-c4383ca739c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:10.549208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:10.568496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c6a6f-dca3-4eaf-800e-09c578a7f3a1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:10.589416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 508/1023] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:10 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:10.590260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c52e75-621e-4eaf-9ce1-c4383ca739c4 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:10.620841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ed633-fd25-4c13-8380-119d30433b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:10.621761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed633-fd25-4c13-8380-119d30433b25 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.622054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed633-fd25-4c13-8380-119d30433b25 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.622716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed633-fd25-4c13-8380-119d30433b25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.638975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ed633-fd25-4c13-8380-119d30433b25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:10.640457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ed633-fd25-4c13-8380-119d30433b25 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-d55ed633-fd25-4c13-8380-119d30433b25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:38:10.657025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:10.658881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 516/1024] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 23 10:38:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:10.659928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ed633-fd25-4c13-8380-119d30433b25 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:10.728195 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c52e75-621e-4eaf-9ce1-c4383ca739c4 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:10.748646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:10.769509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46ac98-b707-4d6c-a5cc-f1be98f3d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:10.770184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46ac98-b707-4d6c-a5cc-f1be98f3d1e6 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.770504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46ac98-b707-4d6c-a5cc-f1be98f3d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.770789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46ac98-b707-4d6c-a5cc-f1be98f3d1e6 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.772361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46ac98-b707-4d6c-a5cc-f1be98f3d1e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:10.773032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46ac98-b707-4d6c-a5cc-f1be98f3d1e6 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:10.785244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ed633-fd25-4c13-8380-119d30433b25 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:10.789122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 509/1025] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:38:10 2022] POST /identity/v3/services => generated 242 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:10.790109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46ac98-b707-4d6c-a5cc-f1be98f3d1e6 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:10.860338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6f5b6-03d0-485d-b39a-6ab26bba4ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:10.861859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f5b6-03d0-485d-b39a-6ab26bba4ef1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:10.863007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f5b6-03d0-485d-b39a-6ab26bba4ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:10.863133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f5b6-03d0-485d-b39a-6ab26bba4ef1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:10.867563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6f5b6-03d0-485d-b39a-6ab26bba4ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:10.869228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6f5b6-03d0-485d-b39a-6ab26bba4ef1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:10.874853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 517/1026] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:10.877464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6f5b6-03d0-485d-b39a-6ab26bba4ef1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:10.892353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:10.961705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46ac98-b707-4d6c-a5cc-f1be98f3d1e6 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:11.015455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f71a-9e83-4d0f-bb80-eac87d930d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:11.015455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f71a-9e83-4d0f-bb80-eac87d930d6d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:11.015752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f71a-9e83-4d0f-bb80-eac87d930d6d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:11.016182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f71a-9e83-4d0f-bb80-eac87d930d6d None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:11.017044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16f71a-9e83-4d0f-bb80-eac87d930d6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:11.017353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16f71a-9e83-4d0f-bb80-eac87d930d6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:11.018880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16f71a-9e83-4d0f-bb80-eac87d930d6d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:11.040049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6f5b6-03d0-485d-b39a-6ab26bba4ef1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:11.045906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 510/1027] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 23 10:38:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:11.047407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f71a-9e83-4d0f-bb80-eac87d930d6d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:11.094198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:11.100769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd08c6-5305-41db-9595-6ec889519341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:11.102562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd08c6-5305-41db-9595-6ec889519341 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:11.102858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd08c6-5305-41db-9595-6ec889519341 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:11.104066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd08c6-5305-41db-9595-6ec889519341 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:11.104857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd08c6-5305-41db-9595-6ec889519341 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:11.106610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd08c6-5305-41db-9595-6ec889519341 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:11.144009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 518/1028] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:38:10 2022] POST /identity/v3/projects => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:11.206385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f71a-9e83-4d0f-bb80-eac87d930d6d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:11.264207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20df27-719f-4815-af0f-b1c28c94e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:11.264939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20df27-719f-4815-af0f-b1c28c94e835 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:11.265229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20df27-719f-4815-af0f-b1c28c94e835 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:11.265596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20df27-719f-4815-af0f-b1c28c94e835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:11.365499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20df27-719f-4815-af0f-b1c28c94e835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:11.368534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20df27-719f-4815-af0f-b1c28c94e835 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:11.415013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:11.510151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 511/1029] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:38:11.515719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd08c6-5305-41db-9595-6ec889519341 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:11.601203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:11.658194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd08c6-5305-41db-9595-6ec889519341 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:11.697670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d0764-ecef-44f7-a6eb-5388dc266a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:11.698422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d0764-ecef-44f7-a6eb-5388dc266a4b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:11.698708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d0764-ecef-44f7-a6eb-5388dc266a4b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:11.698989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d0764-ecef-44f7-a6eb-5388dc266a4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:11.714406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d0764-ecef-44f7-a6eb-5388dc266a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:11.715881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d0764-ecef-44f7-a6eb-5388dc266a4b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-377d0764-ecef-44f7-a6eb-5388dc266a4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:11.734109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:11.735299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:11.736242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:11.736242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:11.736242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:11.736242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:11.736242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 519/1030] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:11.742621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20df27-719f-4815-af0f-b1c28c94e835 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:11.868921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20df27-719f-4815-af0f-b1c28c94e835 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:11.908638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b27a-f047-4695-b2c8-65537a337729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:11.909299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b27a-f047-4695-b2c8-65537a337729 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:11.909580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b27a-f047-4695-b2c8-65537a337729 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:11.909855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832b27a-f047-4695-b2c8-65537a337729 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:11.910604 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b27a-f047-4695-b2c8-65537a337729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:11.910911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b27a-f047-4695-b2c8-65537a337729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:11.912296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832b27a-f047-4695-b2c8-65537a337729 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:11.914157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:11.926303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 512/1031] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:11.933681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d0764-ecef-44f7-a6eb-5388dc266a4b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:12.064128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d0764-ecef-44f7-a6eb-5388dc266a4b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:12.081761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:12.108307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e508d-57bc-410e-bcee-c2d574e2765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:12.109403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e508d-57bc-410e-bcee-c2d574e2765d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:12.109991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e508d-57bc-410e-bcee-c2d574e2765d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:12.110610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e508d-57bc-410e-bcee-c2d574e2765d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:12.118485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e508d-57bc-410e-bcee-c2d574e2765d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:12.120141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e508d-57bc-410e-bcee-c2d574e2765d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-752e508d-57bc-410e-bcee-c2d574e2765d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:38:12.135576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:12.136620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:12.137662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:38:12.137662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:38:12.137662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:38:12.137662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:38:12.137662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:38:12.137662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:38:12.137662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:12.137662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:12.137662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 520/1032] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:12.144844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b27a-f047-4695-b2c8-65537a337729 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:12.263426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832b27a-f047-4695-b2c8-65537a337729 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:12.302956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923393cd-c0c0-4270-9e1f-56a2cb3fa40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:12.304332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923393cd-c0c0-4270-9e1f-56a2cb3fa40d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:12.304881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923393cd-c0c0-4270-9e1f-56a2cb3fa40d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:12.305295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923393cd-c0c0-4270-9e1f-56a2cb3fa40d None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:12.306203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923393cd-c0c0-4270-9e1f-56a2cb3fa40d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:12.306661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923393cd-c0c0-4270-9e1f-56a2cb3fa40d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:12.308231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923393cd-c0c0-4270-9e1f-56a2cb3fa40d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:12.322134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 513/1033] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:12.327775 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e508d-57bc-410e-bcee-c2d574e2765d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:12.441874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e508d-57bc-410e-bcee-c2d574e2765d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:12.480027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69746bf-d84c-4d85-8fe4-e3ca396d7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:12.480688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69746bf-d84c-4d85-8fe4-e3ca396d7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:12.480978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69746bf-d84c-4d85-8fe4-e3ca396d7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:12.481259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69746bf-d84c-4d85-8fe4-e3ca396d7ea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:12.482102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69746bf-d84c-4d85-8fe4-e3ca396d7ea6 None admin] RBAC: Adding query filter params (role.id=74701f1be94d436688021bce42948949, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=0d639e845cfa4f10b8e86cd237664c9b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:12.482466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69746bf-d84c-4d85-8fe4-e3ca396d7ea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:12.483933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69746bf-d84c-4d85-8fe4-e3ca396d7ea6 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:12.495753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 521/1034] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:12 2022] GET /identity/v3/role_assignments?user.id=0d639e845cfa4f10b8e86cd237664c9b&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=74701f1be94d436688021bce42948949 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:12.991802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777e40-e105-45c8-becb-ed882a828e80 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:12.992448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777e40-e105-45c8-becb-ed882a828e80 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:12.992576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777e40-e105-45c8-becb-ed882a828e80 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:12.993950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 514/1035] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:13.003319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28a683-8677-453c-8ab8-790075c97ab0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:13.003858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28a683-8677-453c-8ab8-790075c97ab0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:13.003858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28a683-8677-453c-8ab8-790075c97ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:13.028924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ee28a683-8677-453c-8ab8-790075c97ab0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:13.030125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ee28a683-8677-453c-8ab8-790075c97ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:13.064070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:13.110359 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 522/1036] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:13.133477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777e40-e105-45c8-becb-ed882a828e80 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:13.202078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:13.262287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777e40-e105-45c8-becb-ed882a828e80 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:13.311217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b052b6-4141-4557-ada7-9f0865cff269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:13.312023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b052b6-4141-4557-ada7-9f0865cff269 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:13.312308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b052b6-4141-4557-ada7-9f0865cff269 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:13.312588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b052b6-4141-4557-ada7-9f0865cff269 None admin] PATH_INFO: `/v3/services/image` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:13.313248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b052b6-4141-4557-ada7-9f0865cff269 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:13.314677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b052b6-4141-4557-ada7-9f0865cff269 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-f5b052b6-4141-4557-ada7-9f0865cff269 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:13.327287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:13.328360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:38:13.329222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:13.333508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 515/1037] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 23 10:38:13 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:13.334844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28a683-8677-453c-8ab8-790075c97ab0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:13.396143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835925e7-3d61-4962-9f29-1126cd086b97 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:13.396539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835925e7-3d61-4962-9f29-1126cd086b97 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:13.396885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835925e7-3d61-4962-9f29-1126cd086b97 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:13.398374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 516/1038] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:13.404077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb97a-4bcb-4a85-b209-958ff0226972 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:13.404485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb97a-4bcb-4a85-b209-958ff0226972 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:13.404818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abb97a-4bcb-4a85-b209-958ff0226972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:13.423946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-20abb97a-4bcb-4a85-b209-958ff0226972 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:13.425163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-20abb97a-4bcb-4a85-b209-958ff0226972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:13.451189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28a683-8677-453c-8ab8-790075c97ab0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:13.494277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3986c-e97e-46ea-8c5a-f1ceaf2b92b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:13.494984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3986c-e97e-46ea-8c5a-f1ceaf2b92b4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:13.495271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3986c-e97e-46ea-8c5a-f1ceaf2b92b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:13.495554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3986c-e97e-46ea-8c5a-f1ceaf2b92b4 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:13.496269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3986c-e97e-46ea-8c5a-f1ceaf2b92b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:13.496583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3986c-e97e-46ea-8c5a-f1ceaf2b92b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:13.498088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e3986c-e97e-46ea-8c5a-f1ceaf2b92b4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:13.504396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 523/1039] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:13.510361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3986c-e97e-46ea-8c5a-f1ceaf2b92b4 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:13.512833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 517/1040] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:13.539585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb97a-4bcb-4a85-b209-958ff0226972 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:13.559087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:13.597772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:13.646827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3986c-e97e-46ea-8c5a-f1ceaf2b92b4 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:13.659439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abb97a-4bcb-4a85-b209-958ff0226972 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:13.687696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359c3b-995d-4a61-8e2b-b93608dd7437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:13.688749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359c3b-995d-4a61-8e2b-b93608dd7437 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:13.689228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359c3b-995d-4a61-8e2b-b93608dd7437 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:13.689650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359c3b-995d-4a61-8e2b-b93608dd7437 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:13.690909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359c3b-995d-4a61-8e2b-b93608dd7437 None admin] RBAC: Adding query filter params (type=image) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:13.691418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359c3b-995d-4a61-8e2b-b93608dd7437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:13.693025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359c3b-995d-4a61-8e2b-b93608dd7437 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:13.699393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 524/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:13.705494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359c3b-995d-4a61-8e2b-b93608dd7437 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:13.710159 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e3474-6389-43f9-be9d-4ee032ec6a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:13.711147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e3474-6389-43f9-be9d-4ee032ec6a05 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:13.711438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e3474-6389-43f9-be9d-4ee032ec6a05 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:13.711727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e3474-6389-43f9-be9d-4ee032ec6a05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:13.712994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e3474-6389-43f9-be9d-4ee032ec6a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:13.714497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e3474-6389-43f9-be9d-4ee032ec6a05 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:13.716395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 518/1042] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:13.721799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e3474-6389-43f9-be9d-4ee032ec6a05 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:13.832361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:13.839476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359c3b-995d-4a61-8e2b-b93608dd7437 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:13.860724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e3474-6389-43f9-be9d-4ee032ec6a05 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:13.880174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:13.883798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c29b9f-a981-44ba-b2af-ec2ebc0d8ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:13.884513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c29b9f-a981-44ba-b2af-ec2ebc0d8ff4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:13.884819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c29b9f-a981-44ba-b2af-ec2ebc0d8ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:13.885106 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c29b9f-a981-44ba-b2af-ec2ebc0d8ff4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:13.885909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c29b9f-a981-44ba-b2af-ec2ebc0d8ff4 None admin] RBAC: Adding query filter params (interface=public, service_id=dac7a4ee4d5a48d189bb782989fcbcc5, region_id=RegionOne) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:13.886221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c29b9f-a981-44ba-b2af-ec2ebc0d8ff4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:13.887628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c29b9f-a981-44ba-b2af-ec2ebc0d8ff4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:13.901961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 525/1043] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 23 10:38:13 2022] GET /identity/v3/endpoints?service_id=dac7a4ee4d5a48d189bb782989fcbcc5&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:13.903755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c29b9f-a981-44ba-b2af-ec2ebc0d8ff4 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:13.906033 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9f19d-1d6f-48e3-ac19-b63ddf747538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:13.906894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9f19d-1d6f-48e3-ac19-b63ddf747538 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:13.907179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9f19d-1d6f-48e3-ac19-b63ddf747538 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:13.908601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9f19d-1d6f-48e3-ac19-b63ddf747538 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:13.908601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9f19d-1d6f-48e3-ac19-b63ddf747538 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:13.909632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9f19d-1d6f-48e3-ac19-b63ddf747538 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:13.933511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 519/1044] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:38:13 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:14.062677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c29b9f-a981-44ba-b2af-ec2ebc0d8ff4 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:14.109019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2adff7-e4b6-4a50-abce-809eb20abb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:14.109665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2adff7-e4b6-4a50-abce-809eb20abb2b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:14.109992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2adff7-e4b6-4a50-abce-809eb20abb2b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:14.110268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2adff7-e4b6-4a50-abce-809eb20abb2b None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:14.111740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2adff7-e4b6-4a50-abce-809eb20abb2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:14.112517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2adff7-e4b6-4a50-abce-809eb20abb2b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:14.124147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 526/1045] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 23 10:38:13 2022] GET /identity/v3/services => generated 1957 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:38:14.551008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a232b1-9b37-40e9-8601-ea0614694aba None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:14.551530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a232b1-9b37-40e9-8601-ea0614694aba None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:14.551609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a232b1-9b37-40e9-8601-ea0614694aba None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:14.553086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 520/1046] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:14.559165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3cf46-0090-4fc9-b762-54c445a45eec None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:14.559550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3cf46-0090-4fc9-b762-54c445a45eec None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:14.559818 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3cf46-0090-4fc9-b762-54c445a45eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:14.578123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d7c3cf46-0090-4fc9-b762-54c445a45eec None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:14.579339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d7c3cf46-0090-4fc9-b762-54c445a45eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:14.601360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:14.657902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 527/1047] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:14.681228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a232b1-9b37-40e9-8601-ea0614694aba None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:14.800042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a232b1-9b37-40e9-8601-ea0614694aba None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:14.837157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db928a-f5bb-41a7-bbe0-ccc237059e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:14.837968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db928a-f5bb-41a7-bbe0-ccc237059e83 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:14.838253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db928a-f5bb-41a7-bbe0-ccc237059e83 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:14.838564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db928a-f5bb-41a7-bbe0-ccc237059e83 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:14.852165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db928a-f5bb-41a7-bbe0-ccc237059e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-a1db928a-f5bb-41a7-bbe0-ccc237059e83 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:14.860211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:14.861215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:38:14.862078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:14.867071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 521/1048] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 23 10:38:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:14.868334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3cf46-0090-4fc9-b762-54c445a45eec None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:14.982950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3cf46-0090-4fc9-b762-54c445a45eec None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:15.020166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5db92-7c28-4909-bb21-c57c6c8ea9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:15.020834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5db92-7c28-4909-bb21-c57c6c8ea9d1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:15.021122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5db92-7c28-4909-bb21-c57c6c8ea9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:15.021400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5db92-7c28-4909-bb21-c57c6c8ea9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:15.022160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5db92-7c28-4909-bb21-c57c6c8ea9d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:15.022535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5db92-7c28-4909-bb21-c57c6c8ea9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:15.023931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5db92-7c28-4909-bb21-c57c6c8ea9d1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:15.043751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 528/1049] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 23 10:38:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:15.045002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db928a-f5bb-41a7-bbe0-ccc237059e83 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:15.080782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:15.164926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db928a-f5bb-41a7-bbe0-ccc237059e83 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:15.211651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a655c1b-1d33-4603-bfcb-6e43d55d1f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:15.212463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a655c1b-1d33-4603-bfcb-6e43d55d1f6d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:15.212742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a655c1b-1d33-4603-bfcb-6e43d55d1f6d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:15.213023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a655c1b-1d33-4603-bfcb-6e43d55d1f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:15.224055 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a655c1b-1d33-4603-bfcb-6e43d55d1f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:15.226233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a655c1b-1d33-4603-bfcb-6e43d55d1f6d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-2a655c1b-1d33-4603-bfcb-6e43d55d1f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:15.246767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:15.247744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:15.248652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:15.248652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:15.248652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:15.248652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:15.252729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 522/1050] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:15.254202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5db92-7c28-4909-bb21-c57c6c8ea9d1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:15.275057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:15.373900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5db92-7c28-4909-bb21-c57c6c8ea9d1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:15.408282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023eb4d-d621-488a-9f32-41ec76b69ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:15.408964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023eb4d-d621-488a-9f32-41ec76b69ede None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:15.409247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023eb4d-d621-488a-9f32-41ec76b69ede None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:15.409526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023eb4d-d621-488a-9f32-41ec76b69ede None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:15.410267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023eb4d-d621-488a-9f32-41ec76b69ede None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:15.410608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023eb4d-d621-488a-9f32-41ec76b69ede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:15.412007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023eb4d-d621-488a-9f32-41ec76b69ede None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:15.435168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 529/1051] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:15.436429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a655c1b-1d33-4603-bfcb-6e43d55d1f6d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:15.558065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:15.579912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a655c1b-1d33-4603-bfcb-6e43d55d1f6d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:15.617439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482183-e848-412e-9a31-2b73fbb399b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:15.618230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482183-e848-412e-9a31-2b73fbb399b8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:15.618554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482183-e848-412e-9a31-2b73fbb399b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:15.618826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd482183-e848-412e-9a31-2b73fbb399b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:15.626880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd482183-e848-412e-9a31-2b73fbb399b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:15.629971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd482183-e848-412e-9a31-2b73fbb399b8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-dd482183-e848-412e-9a31-2b73fbb399b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:38:15.645560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:15.646962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:38:15.648576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:15.654153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 523/1052] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 23 10:38:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:15.655161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023eb4d-d621-488a-9f32-41ec76b69ede None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:15.744766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:15.773042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023eb4d-d621-488a-9f32-41ec76b69ede None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:15.810071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ad5a3-faa3-416d-8f5c-f5d353029019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:15.810785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ad5a3-faa3-416d-8f5c-f5d353029019 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:15.811072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ad5a3-faa3-416d-8f5c-f5d353029019 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:15.811393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ad5a3-faa3-416d-8f5c-f5d353029019 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:15.812209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ad5a3-faa3-416d-8f5c-f5d353029019 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:15.812515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ad5a3-faa3-416d-8f5c-f5d353029019 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:15.813964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ad5a3-faa3-416d-8f5c-f5d353029019 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:15.839014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 530/1053] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 23 10:38:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:15.840295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482183-e848-412e-9a31-2b73fbb399b8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:15.954227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd482183-e848-412e-9a31-2b73fbb399b8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:15.991687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07b85-8a8f-4e0a-acd8-7a9007dcf526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:15.992492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07b85-8a8f-4e0a-acd8-7a9007dcf526 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:15.992776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07b85-8a8f-4e0a-acd8-7a9007dcf526 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:15.993055 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07b85-8a8f-4e0a-acd8-7a9007dcf526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.006018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07b85-8a8f-4e0a-acd8-7a9007dcf526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:16.008153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07b85-8a8f-4e0a-acd8-7a9007dcf526 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:16.011015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-e1c07b85-8a8f-4e0a-acd8-7a9007dcf526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:16.029269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:16.035235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:16.036203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:16.036203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:16.036203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:16.036203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:16.036203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 524/1054] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:16.036518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ad5a3-faa3-416d-8f5c-f5d353029019 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:16.142573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68c96-d3b0-41af-8a88-eb2d7ec3a498 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.142810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68c96-d3b0-41af-8a88-eb2d7ec3a498 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.143072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68c96-d3b0-41af-8a88-eb2d7ec3a498 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.144628 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 525/1055] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:16.150439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5450c0-1f19-4d00-9ddc-f40a69b5990b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.150739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5450c0-1f19-4d00-9ddc-f40a69b5990b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.151027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5450c0-1f19-4d00-9ddc-f40a69b5990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.166186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ad5a3-faa3-416d-8f5c-f5d353029019 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:16.169672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-5a5450c0-1f19-4d00-9ddc-f40a69b5990b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:16.170917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5a5450c0-1f19-4d00-9ddc-f40a69b5990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:16.205643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582470a5-f490-4bbb-bf77-096486182e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:16.206416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582470a5-f490-4bbb-bf77-096486182e92 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.206694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582470a5-f490-4bbb-bf77-096486182e92 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.207326 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582470a5-f490-4bbb-bf77-096486182e92 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.208053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582470a5-f490-4bbb-bf77-096486182e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:16.208359 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582470a5-f490-4bbb-bf77-096486182e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:16.210246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582470a5-f490-4bbb-bf77-096486182e92 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:16.212043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:16.229105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 531/1056] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:16.229937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582470a5-f490-4bbb-bf77-096486182e92 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:16.266400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 526/1057] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:16.278172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef8af-16a7-45e5-b6b4-af8cebd4f2c3 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.278521 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef8af-16a7-45e5-b6b4-af8cebd4f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.278781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef8af-16a7-45e5-b6b4-af8cebd4f2c3 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.280342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 527/1058] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:16.287256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eccfc1-9297-4220-8344-aeee7c76da65 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.287551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eccfc1-9297-4220-8344-aeee7c76da65 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.288435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eccfc1-9297-4220-8344-aeee7c76da65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.305997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b6eccfc1-9297-4220-8344-aeee7c76da65 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:16.307252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b6eccfc1-9297-4220-8344-aeee7c76da65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:16.355940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582470a5-f490-4bbb-bf77-096486182e92 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:16.377631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 528/1059] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:16.378518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eccfc1-9297-4220-8344-aeee7c76da65 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:16.391205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d16e09-556e-4e0b-8634-4457251cb724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:16.392002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d16e09-556e-4e0b-8634-4457251cb724 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.392288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d16e09-556e-4e0b-8634-4457251cb724 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.392566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d16e09-556e-4e0b-8634-4457251cb724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.401195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d16e09-556e-4e0b-8634-4457251cb724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:16.402685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d16e09-556e-4e0b-8634-4457251cb724 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-f8d16e09-556e-4e0b-8634-4457251cb724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:38:16.418758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:16.419823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:16.420787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:38:16.420787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:38:16.420787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:38:16.420787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:38:16.420787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:38:16.420787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:38:16.420787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:16.420787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:16.420787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 532/1060] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:16.421312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d16e09-556e-4e0b-8634-4457251cb724 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:16.445438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:16.486408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:16.494362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eccfc1-9297-4220-8344-aeee7c76da65 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:16.530970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114053cd-bb1d-4086-b4b7-fb27e176bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:16.531762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114053cd-bb1d-4086-b4b7-fb27e176bd03 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.532043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114053cd-bb1d-4086-b4b7-fb27e176bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.532319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114053cd-bb1d-4086-b4b7-fb27e176bd03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.545098 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d16e09-556e-4e0b-8634-4457251cb724 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:16.546450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114053cd-bb1d-4086-b4b7-fb27e176bd03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-114053cd-bb1d-4086-b4b7-fb27e176bd03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:16.554895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:16.561781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 529/1061] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:16.562966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114053cd-bb1d-4086-b4b7-fb27e176bd03 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:16.590218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedb5b1-f370-409c-beaa-0341ae2ff3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:16.591033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedb5b1-f370-409c-beaa-0341ae2ff3a4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.591370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedb5b1-f370-409c-beaa-0341ae2ff3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.591651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedb5b1-f370-409c-beaa-0341ae2ff3a4 None admin] PATH_INFO: `/v3/services/image` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.592336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedb5b1-f370-409c-beaa-0341ae2ff3a4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:16.593759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedb5b1-f370-409c-beaa-0341ae2ff3a4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-4dedb5b1-f370-409c-beaa-0341ae2ff3a4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:16.605953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:16.607347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:16.608989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 533/1062] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jun 23 10:38:16 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:16.609829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedb5b1-f370-409c-beaa-0341ae2ff3a4 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:16.669358 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114053cd-bb1d-4086-b4b7-fb27e176bd03 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:16.686762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:16.707569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38b4a-9864-4004-ace6-4d5018f8bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:16.708230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38b4a-9864-4004-ace6-4d5018f8bf62 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.708514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38b4a-9864-4004-ace6-4d5018f8bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.708799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e38b4a-9864-4004-ace6-4d5018f8bf62 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.709592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e38b4a-9864-4004-ace6-4d5018f8bf62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:16.710073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e38b4a-9864-4004-ace6-4d5018f8bf62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:16.711576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e38b4a-9864-4004-ace6-4d5018f8bf62 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:16.715656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedb5b1-f370-409c-beaa-0341ae2ff3a4 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:16.731084 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 530/1063] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:16.732017 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38b4a-9864-4004-ace6-4d5018f8bf62 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:16.733615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:16.752905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58ee5d-2420-4fad-b534-a5b5a451c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:16.753577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58ee5d-2420-4fad-b534-a5b5a451c54f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.753867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58ee5d-2420-4fad-b534-a5b5a451c54f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.754145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58ee5d-2420-4fad-b534-a5b5a451c54f None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.754941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58ee5d-2420-4fad-b534-a5b5a451c54f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:16.755249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58ee5d-2420-4fad-b534-a5b5a451c54f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:16.756699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58ee5d-2420-4fad-b534-a5b5a451c54f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:16.765133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 534/1064] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:16.765951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58ee5d-2420-4fad-b534-a5b5a451c54f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:16.845621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e38b4a-9864-4004-ace6-4d5018f8bf62 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:16.874540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58ee5d-2420-4fad-b534-a5b5a451c54f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:16.881798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d408cf1-a263-4e73-b90b-77e62eda0090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:16.882767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d408cf1-a263-4e73-b90b-77e62eda0090 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.883058 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d408cf1-a263-4e73-b90b-77e62eda0090 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.883339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d408cf1-a263-4e73-b90b-77e62eda0090 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.884054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d408cf1-a263-4e73-b90b-77e62eda0090 None admin] RBAC: Adding query filter params (name=image) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:16.884360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d408cf1-a263-4e73-b90b-77e62eda0090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:16.885745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d408cf1-a263-4e73-b90b-77e62eda0090 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:16.890883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 531/1065] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:16.891764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d408cf1-a263-4e73-b90b-77e62eda0090 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:16.922376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e4133-2975-4333-af45-e5183acfc3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:16.923398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e4133-2975-4333-af45-e5183acfc3fe None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:16.923690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e4133-2975-4333-af45-e5183acfc3fe None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:16.923971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e4133-2975-4333-af45-e5183acfc3fe None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/0d639e845cfa4f10b8e86cd237664c9b/roles/74701f1be94d436688021bce42948949` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:16.926258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e4133-2975-4333-af45-e5183acfc3fe None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=0d639e845cfa4f10b8e86cd237664c9b, role_id=74701f1be94d436688021bce42948949)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:16.927747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e4133-2975-4333-af45-e5183acfc3fe None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:16.936151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:16.941355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 535/1066] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:16 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/0d639e845cfa4f10b8e86cd237664c9b/roles/74701f1be94d436688021bce42948949 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:38:16.942192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e4133-2975-4333-af45-e5183acfc3fe None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:17.012472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:17.013452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d408cf1-a263-4e73-b90b-77e62eda0090 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:17.070701 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8bc27-5356-452d-a84d-9fb38bb52d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:17.071676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8bc27-5356-452d-a84d-9fb38bb52d25 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:17.072008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8bc27-5356-452d-a84d-9fb38bb52d25 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:17.072288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8bc27-5356-452d-a84d-9fb38bb52d25 None admin] PATH_INFO: `/v3/users/a5dce404a28d474ea0092cd67c3d3292` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:17.089134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e4133-2975-4333-af45-e5183acfc3fe None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:17.090171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8bc27-5356-452d-a84d-9fb38bb52d25 None admin] RBAC: Authorizing `identity:get_user(user_id=a5dce404a28d474ea0092cd67c3d3292)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:17.091893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8bc27-5356-452d-a84d-9fb38bb52d25 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:17.093721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 532/1067] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:16 2022] GET /identity/v3/users/a5dce404a28d474ea0092cd67c3d3292 => generated 285 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:17.101020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8bc27-5356-452d-a84d-9fb38bb52d25 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:17.139022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d8f0-59b8-4740-ae4a-e8c4050de103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:17.139854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d8f0-59b8-4740-ae4a-e8c4050de103 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:17.140292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d8f0-59b8-4740-ae4a-e8c4050de103 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:17.140627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d8f0-59b8-4740-ae4a-e8c4050de103 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:17.141424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d8f0-59b8-4740-ae4a-e8c4050de103 None admin] RBAC: Adding query filter params (type=image) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:17.141808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d8f0-59b8-4740-ae4a-e8c4050de103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:17.143306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d8f0-59b8-4740-ae4a-e8c4050de103 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:17.154122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 536/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:17.167752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d8f0-59b8-4740-ae4a-e8c4050de103 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:17.247121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:17.253467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8bc27-5356-452d-a84d-9fb38bb52d25 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:17.297990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c921-1012-46b3-b2da-df1c03ba7861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:17.298621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c921-1012-46b3-b2da-df1c03ba7861 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:17.298904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c921-1012-46b3-b2da-df1c03ba7861 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:17.299321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c921-1012-46b3-b2da-df1c03ba7861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:17.299421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d8f0-59b8-4740-ae4a-e8c4050de103 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:17.302898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:17.340990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68940e2-8311-43bf-b9da-b303d1c4304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:17.341657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68940e2-8311-43bf-b9da-b303d1c4304a None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:17.341946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68940e2-8311-43bf-b9da-b303d1c4304a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:17.342225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68940e2-8311-43bf-b9da-b303d1c4304a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:17.343018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68940e2-8311-43bf-b9da-b303d1c4304a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:17.345778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68940e2-8311-43bf-b9da-b303d1c4304a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:17.369290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 537/1069] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 23 10:38:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:17.405525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7c921-1012-46b3-b2da-df1c03ba7861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:17.407109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7c921-1012-46b3-b2da-df1c03ba7861 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:17.545011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:17.550939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 533/1070] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:38:17.557736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68940e2-8311-43bf-b9da-b303d1c4304a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:17.680650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68940e2-8311-43bf-b9da-b303d1c4304a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:17.717270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4744d3-b265-412b-a30f-8a900912df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:17.718125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4744d3-b265-412b-a30f-8a900912df94 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:17.718438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4744d3-b265-412b-a30f-8a900912df94 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:17.718717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4744d3-b265-412b-a30f-8a900912df94 None admin] PATH_INFO: `/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:17.719907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4744d3-b265-412b-a30f-8a900912df94 None admin] RBAC: Authorizing `identity:get_project(project_id=bc3e92eae5394f5281f7b682b2f0c2a5)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:17.721333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4744d3-b265-412b-a30f-8a900912df94 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:17.723278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 538/1071] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:17 2022] GET /identity/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:17.729650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c921-1012-46b3-b2da-df1c03ba7861 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:17.847933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c921-1012-46b3-b2da-df1c03ba7861 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:17.887588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99b011-d647-49ec-b930-5b16c0352ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:17.888248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99b011-d647-49ec-b930-5b16c0352ced None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:17.888530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99b011-d647-49ec-b930-5b16c0352ced None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:17.888807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99b011-d647-49ec-b930-5b16c0352ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:17.889641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99b011-d647-49ec-b930-5b16c0352ced None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=bc3e92eae5394f5281f7b682b2f0c2a5, user.id=a5dce404a28d474ea0092cd67c3d3292) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:17.889953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99b011-d647-49ec-b930-5b16c0352ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:17.891431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99b011-d647-49ec-b930-5b16c0352ced None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:17.898625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 534/1072] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:17 2022] GET /identity/v3/role_assignments?user.id=a5dce404a28d474ea0092cd67c3d3292&scope.project.id=bc3e92eae5394f5281f7b682b2f0c2a5&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:19.060706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909dd87-df3a-49ff-a53b-e21ac9c2d199 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.061449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909dd87-df3a-49ff-a53b-e21ac9c2d199 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.061449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909dd87-df3a-49ff-a53b-e21ac9c2d199 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.062673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 539/1073] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:19.068611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a3c7-379d-4101-b8ce-ea0e5b92b3a5 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.069569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a3c7-379d-4101-b8ce-ea0e5b92b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.069816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a3c7-379d-4101-b8ce-ea0e5b92b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.087995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-4a40a3c7-379d-4101-b8ce-ea0e5b92b3a5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:19.089197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4a40a3c7-379d-4101-b8ce-ea0e5b92b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:19.151540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:19.164230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 535/1074] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:19.188154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909dd87-df3a-49ff-a53b-e21ac9c2d199 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:19.216262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:19.319895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909dd87-df3a-49ff-a53b-e21ac9c2d199 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:19.357335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c074-3533-4593-9bb9-02263f35c53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:19.358158 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c074-3533-4593-9bb9-02263f35c53f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.358485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c074-3533-4593-9bb9-02263f35c53f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.358773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1c074-3533-4593-9bb9-02263f35c53f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.370169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1c074-3533-4593-9bb9-02263f35c53f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-3be1c074-3533-4593-9bb9-02263f35c53f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:19.378453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:19.379509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:38:19.380468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:19.384897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 540/1075] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jun 23 10:38:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:19.386547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a3c7-379d-4101-b8ce-ea0e5b92b3a5 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:19.499022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a3c7-379d-4101-b8ce-ea0e5b92b3a5 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:19.544370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02661e65-c91b-49dc-81b2-a1a419f3157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:19.545051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661e65-c91b-49dc-81b2-a1a419f3157a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.545334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661e65-c91b-49dc-81b2-a1a419f3157a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.545618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02661e65-c91b-49dc-81b2-a1a419f3157a None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.546402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661e65-c91b-49dc-81b2-a1a419f3157a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:19.546713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661e65-c91b-49dc-81b2-a1a419f3157a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:19.548120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02661e65-c91b-49dc-81b2-a1a419f3157a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:19.562358 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 536/1076] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 23 10:38:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:19.564007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c074-3533-4593-9bb9-02263f35c53f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:19.571460 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563a9d9-0bfe-41a7-bfd6-e2a12c767e70 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.571675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563a9d9-0bfe-41a7-bfd6-e2a12c767e70 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.571955 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563a9d9-0bfe-41a7-bfd6-e2a12c767e70 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.573356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 537/1077] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:19.579037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44438f39-fefc-49ff-80b4-2339fca9f697 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.579525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44438f39-fefc-49ff-80b4-2339fca9f697 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.579813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44438f39-fefc-49ff-80b4-2339fca9f697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.598334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-44438f39-fefc-49ff-80b4-2339fca9f697 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:19.599581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-44438f39-fefc-49ff-80b4-2339fca9f697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:19.657073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:19.682378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 538/1078] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:38:19.682641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:19.698702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1c074-3533-4593-9bb9-02263f35c53f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:19.700429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44438f39-fefc-49ff-80b4-2339fca9f697 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:19.738439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123e909-c379-4957-9216-1298cda23465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:19.739230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123e909-c379-4957-9216-1298cda23465 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.739512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123e909-c379-4957-9216-1298cda23465 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.739779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123e909-c379-4957-9216-1298cda23465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.751742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123e909-c379-4957-9216-1298cda23465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:19.753200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123e909-c379-4957-9216-1298cda23465 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-d123e909-c379-4957-9216-1298cda23465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:19.772444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:19.773697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:19.774830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:19.774830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:19.774830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:19.774830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:19.778563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 541/1079] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:19.779483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123e909-c379-4957-9216-1298cda23465 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:19.827444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44438f39-fefc-49ff-80b4-2339fca9f697 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:19.874288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225327ce-a017-402e-b00d-36b831f8481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:19.875285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225327ce-a017-402e-b00d-36b831f8481e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.875779 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225327ce-a017-402e-b00d-36b831f8481e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.876247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225327ce-a017-402e-b00d-36b831f8481e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.913981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123e909-c379-4957-9216-1298cda23465 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:19.936547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:19.956552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225327ce-a017-402e-b00d-36b831f8481e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:19.958217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225327ce-a017-402e-b00d-36b831f8481e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:19.962330 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab33e7-6d4f-4f22-b34b-93181333e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:19.963016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab33e7-6d4f-4f22-b34b-93181333e35a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.963300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab33e7-6d4f-4f22-b34b-93181333e35a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.963578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab33e7-6d4f-4f22-b34b-93181333e35a None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.964390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab33e7-6d4f-4f22-b34b-93181333e35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:19.964694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab33e7-6d4f-4f22-b34b-93181333e35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:19.966078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab33e7-6d4f-4f22-b34b-93181333e35a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:19.970358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:19.981248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 542/1080] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:19.983047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8694-0c79-402f-94a4-d6bd75d29f2f None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:19.983047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8694-0c79-402f-94a4-d6bd75d29f2f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:19.983348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8694-0c79-402f-94a4-d6bd75d29f2f None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:19.984739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 543/1081] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:19.988491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a8694-0c79-402f-94a4-d6bd75d29f2f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.071274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 539/1082] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:38:20.072593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac645b-8dc8-4372-bf44-2d001efaee97 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:20.072881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac645b-8dc8-4372-bf44-2d001efaee97 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:20.073158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac645b-8dc8-4372-bf44-2d001efaee97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:20.089867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-63ac645b-8dc8-4372-bf44-2d001efaee97 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:20.091017 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-63ac645b-8dc8-4372-bf44-2d001efaee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:20.099399 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a8694-0c79-402f-94a4-d6bd75d29f2f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:20.135559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eaf55-29e5-442d-829d-05209ca9382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:20.136350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eaf55-29e5-442d-829d-05209ca9382c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:20.136635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eaf55-29e5-442d-829d-05209ca9382c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:20.136914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eaf55-29e5-442d-829d-05209ca9382c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:20.144885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eaf55-29e5-442d-829d-05209ca9382c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:20.146351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eaf55-29e5-442d-829d-05209ca9382c None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-5f6eaf55-29e5-442d-829d-05209ca9382c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:38:20.161958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:20.163822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:38:20.164800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:20.171258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 540/1083] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:20.171258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac645b-8dc8-4372-bf44-2d001efaee97 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.171396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 544/1084] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jun 23 10:38:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:20.171949 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eaf55-29e5-442d-829d-05209ca9382c None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.187412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:20.235602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:20.276486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac645b-8dc8-4372-bf44-2d001efaee97 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:20.285205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eaf55-29e5-442d-829d-05209ca9382c None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:20.313530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a6d91-d54d-42ec-a218-84ec180dfdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:20.314358 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a6d91-d54d-42ec-a218-84ec180dfdf5 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:20.314658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a6d91-d54d-42ec-a218-84ec180dfdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:20.314935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a6d91-d54d-42ec-a218-84ec180dfdf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:20.323323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d33a6-7950-4d21-af4c-dc1e85591d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:20.323993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d33a6-7950-4d21-af4c-dc1e85591d17 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:20.324277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d33a6-7950-4d21-af4c-dc1e85591d17 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:20.324552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d33a6-7950-4d21-af4c-dc1e85591d17 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:20.325395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d33a6-7950-4d21-af4c-dc1e85591d17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:20.325704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d33a6-7950-4d21-af4c-dc1e85591d17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:20.327169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d33a6-7950-4d21-af4c-dc1e85591d17 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:20.328108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a6d91-d54d-42ec-a218-84ec180dfdf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:20.329562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a6d91-d54d-42ec-a218-84ec180dfdf5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:20.345835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 545/1085] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jun 23 10:38:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:20.346628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d33a6-7950-4d21-af4c-dc1e85591d17 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-c43a6d91-d54d-42ec-a218-84ec180dfdf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:20.347884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:20.348756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:20.351136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:20.351136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:20.351136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:20.351136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:20.351136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 541/1086] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:20.352026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a6d91-d54d-42ec-a218-84ec180dfdf5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.425543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:20.452966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d33a6-7950-4d21-af4c-dc1e85591d17 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:20.463135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a6d91-d54d-42ec-a218-84ec180dfdf5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:20.468882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:20.490001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62586e0c-4e7c-4238-aa54-ed093a0482d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:20.490844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62586e0c-4e7c-4238-aa54-ed093a0482d9 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:20.491306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62586e0c-4e7c-4238-aa54-ed093a0482d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:20.491582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62586e0c-4e7c-4238-aa54-ed093a0482d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:20.502178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62586e0c-4e7c-4238-aa54-ed093a0482d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:20.504145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cc55e-2d56-4f25-9f0c-7da7ef4f5308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:20.504796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cc55e-2d56-4f25-9f0c-7da7ef4f5308 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:20.505066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cc55e-2d56-4f25-9f0c-7da7ef4f5308 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:20.505346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cc55e-2d56-4f25-9f0c-7da7ef4f5308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-62586e0c-4e7c-4238-aa54-ed093a0482d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:20.511230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:20.512754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 546/1087] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:20.513918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62586e0c-4e7c-4238-aa54-ed093a0482d9 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.590504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cc55e-2d56-4f25-9f0c-7da7ef4f5308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:20.591957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cc55e-2d56-4f25-9f0c-7da7ef4f5308 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:20.634102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62586e0c-4e7c-4238-aa54-ed093a0482d9 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:20.665048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:20.670625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f953-58ec-4daf-b060-03757f5e9a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:20.671306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f953-58ec-4daf-b060-03757f5e9a3e None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:20.671611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f953-58ec-4daf-b060-03757f5e9a3e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:20.672642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f953-58ec-4daf-b060-03757f5e9a3e None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:20.672642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963f953-58ec-4daf-b060-03757f5e9a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:20.672899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963f953-58ec-4daf-b060-03757f5e9a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:20.674285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963f953-58ec-4daf-b060-03757f5e9a3e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:20.687142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 547/1088] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:20.688005 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f953-58ec-4daf-b060-03757f5e9a3e None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.712551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 542/1089] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:38:20.718278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cc55e-2d56-4f25-9f0c-7da7ef4f5308 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.731866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:20.830666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f953-58ec-4daf-b060-03757f5e9a3e None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:20.853711 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cc55e-2d56-4f25-9f0c-7da7ef4f5308 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:20.877167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3df84-b13a-4a46-9bd1-3d5f47e62944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:20.877852 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3df84-b13a-4a46-9bd1-3d5f47e62944 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:20.878131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3df84-b13a-4a46-9bd1-3d5f47e62944 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:20.878486 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3df84-b13a-4a46-9bd1-3d5f47e62944 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:20.879240 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3df84-b13a-4a46-9bd1-3d5f47e62944 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:20.879546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3df84-b13a-4a46-9bd1-3d5f47e62944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:20.881113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3df84-b13a-4a46-9bd1-3d5f47e62944 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:20.892089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 548/1090] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:20.898603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3df84-b13a-4a46-9bd1-3d5f47e62944 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.905005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af885593-1178-4094-88bd-1f0d0bab9b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:20.905813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af885593-1178-4094-88bd-1f0d0bab9b5e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:20.906098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af885593-1178-4094-88bd-1f0d0bab9b5e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:20.907090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af885593-1178-4094-88bd-1f0d0bab9b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:20.918488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af885593-1178-4094-88bd-1f0d0bab9b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:20.920036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af885593-1178-4094-88bd-1f0d0bab9b5e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-af885593-1178-4094-88bd-1f0d0bab9b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:20.938912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:20.940303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:20.941745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:38:20.941745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:20.941745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:38:20.941745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:20.941745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 543/1091] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:20.948249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af885593-1178-4094-88bd-1f0d0bab9b5e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:20.970487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:21.028274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:21.035812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3df84-b13a-4a46-9bd1-3d5f47e62944 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:21.066285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af885593-1178-4094-88bd-1f0d0bab9b5e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:21.070777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6b15b-90eb-4274-b4f1-3e56dfcbcfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:21.071792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6b15b-90eb-4274-b4f1-3e56dfcbcfcf None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:21.072378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6b15b-90eb-4274-b4f1-3e56dfcbcfcf None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:21.072378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6b15b-90eb-4274-b4f1-3e56dfcbcfcf None admin] PATH_INFO: `/v3/users/a5dce404a28d474ea0092cd67c3d3292` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:21.073550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6b15b-90eb-4274-b4f1-3e56dfcbcfcf None admin] RBAC: Authorizing `identity:get_user(user_id=a5dce404a28d474ea0092cd67c3d3292)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:21.075042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6b15b-90eb-4274-b4f1-3e56dfcbcfcf None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:21.076885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 549/1092] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:20 2022] GET /identity/v3/users/a5dce404a28d474ea0092cd67c3d3292 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:21.082371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6b15b-90eb-4274-b4f1-3e56dfcbcfcf None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:21.108728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae08f31-10f9-44e7-a973-d9ca494f21ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:21.109447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae08f31-10f9-44e7-a973-d9ca494f21ff None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:21.109702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae08f31-10f9-44e7-a973-d9ca494f21ff None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:21.109979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae08f31-10f9-44e7-a973-d9ca494f21ff None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:21.110734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae08f31-10f9-44e7-a973-d9ca494f21ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:21.111065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae08f31-10f9-44e7-a973-d9ca494f21ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:21.112471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae08f31-10f9-44e7-a973-d9ca494f21ff None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:21.124348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 544/1093] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:21.129937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae08f31-10f9-44e7-a973-d9ca494f21ff None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:21.190213 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6b15b-90eb-4274-b4f1-3e56dfcbcfcf None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:21.214237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:21.227228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8520e1-bd06-4852-adcf-e4ab30cab666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:21.228091 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8520e1-bd06-4852-adcf-e4ab30cab666 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:21.228372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8520e1-bd06-4852-adcf-e4ab30cab666 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:21.228647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8520e1-bd06-4852-adcf-e4ab30cab666 None admin] PATH_INFO: `/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:21.229842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8520e1-bd06-4852-adcf-e4ab30cab666 None admin] RBAC: Authorizing `identity:get_project(project_id=bc3e92eae5394f5281f7b682b2f0c2a5)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:21.231308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8520e1-bd06-4852-adcf-e4ab30cab666 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:21.233029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 550/1094] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:21 2022] GET /identity/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:21.238672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae08f31-10f9-44e7-a973-d9ca494f21ff None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:21.238842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8520e1-bd06-4852-adcf-e4ab30cab666 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:21.274042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:21.276389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f937b-857d-4120-af27-bfd6c99cac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:21.277108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f937b-857d-4120-af27-bfd6c99cac38 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:21.277392 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f937b-857d-4120-af27-bfd6c99cac38 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:21.277674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f937b-857d-4120-af27-bfd6c99cac38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:21.285077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f937b-857d-4120-af27-bfd6c99cac38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:21.286575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f937b-857d-4120-af27-bfd6c99cac38 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-4b5f937b-857d-4120-af27-bfd6c99cac38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:38:21.302723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:21.304525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:21.305547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:38:21.305547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:38:21.305547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:38:21.305547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:38:21.305547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:38:21.305547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:38:21.305547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:38:21.305547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:21.305547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 545/1095] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:38:21.311546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f937b-857d-4120-af27-bfd6c99cac38 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:21.349231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8520e1-bd06-4852-adcf-e4ab30cab666 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:21.384730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cadfb-ffa7-4fe4-b154-1d2f37560b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:21.385633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cadfb-ffa7-4fe4-b154-1d2f37560b7d None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:21.385900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cadfb-ffa7-4fe4-b154-1d2f37560b7d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:21.386173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cadfb-ffa7-4fe4-b154-1d2f37560b7d None admin] PATH_INFO: `/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5/users/a5dce404a28d474ea0092cd67c3d3292/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:21.388220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cadfb-ffa7-4fe4-b154-1d2f37560b7d None admin] RBAC: Authorizing `identity:create_grant(project_id=bc3e92eae5394f5281f7b682b2f0c2a5, user_id=a5dce404a28d474ea0092cd67c3d3292, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:21.389654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cadfb-ffa7-4fe4-b154-1d2f37560b7d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:21.405170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 551/1096] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:21 2022] PUT /identity/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5/users/a5dce404a28d474ea0092cd67c3d3292/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:38:21.428804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f937b-857d-4120-af27-bfd6c99cac38 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:21.467720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e21e6d-2e9c-43c8-be2b-094da502c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:21.468302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e21e6d-2e9c-43c8-be2b-094da502c5cd None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:21.468582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e21e6d-2e9c-43c8-be2b-094da502c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:21.468854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e21e6d-2e9c-43c8-be2b-094da502c5cd None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:21.469643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e21e6d-2e9c-43c8-be2b-094da502c5cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:21.469947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e21e6d-2e9c-43c8-be2b-094da502c5cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:21.471429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e21e6d-2e9c-43c8-be2b-094da502c5cd None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:21.480940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:21.490721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 546/1097] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:38:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:21.493827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cadfb-ffa7-4fe4-b154-1d2f37560b7d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:21.608106 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:21.619337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cadfb-ffa7-4fe4-b154-1d2f37560b7d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:21.659881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6692c22-aada-4998-8bb4-a10e92830ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:21.660541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6692c22-aada-4998-8bb4-a10e92830ee4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:21.660828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6692c22-aada-4998-8bb4-a10e92830ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:21.661111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6692c22-aada-4998-8bb4-a10e92830ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:21.661958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6692c22-aada-4998-8bb4-a10e92830ee4 None admin] RBAC: Adding query filter params (role.id=74701f1be94d436688021bce42948949, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=0d639e845cfa4f10b8e86cd237664c9b) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:21.662273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6692c22-aada-4998-8bb4-a10e92830ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:21.664361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6692c22-aada-4998-8bb4-a10e92830ee4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:21.670812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 552/1098] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:21 2022] GET /identity/v3/role_assignments?user.id=0d639e845cfa4f10b8e86cd237664c9b&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=74701f1be94d436688021bce42948949 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:23.465419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ba8c6-d08a-43d4-b7ac-96a953533b92 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:23.465988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ba8c6-d08a-43d4-b7ac-96a953533b92 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:23.465988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ba8c6-d08a-43d4-b7ac-96a953533b92 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:23.467399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 547/1099] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:23.472742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd869d1-af9d-4675-a027-13a51811523f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:23.473204 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd869d1-af9d-4675-a027-13a51811523f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:23.473298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd869d1-af9d-4675-a027-13a51811523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:23.490333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2fd869d1-af9d-4675-a027-13a51811523f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:23.492161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2fd869d1-af9d-4675-a027-13a51811523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:23.564564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 553/1100] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:23.588378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ba8c6-d08a-43d4-b7ac-96a953533b92 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:23.698403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ba8c6-d08a-43d4-b7ac-96a953533b92 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:23.733854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad98e68-6320-4b4c-95fe-497c2374d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:23.734596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad98e68-6320-4b4c-95fe-497c2374d469 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:23.734882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad98e68-6320-4b4c-95fe-497c2374d469 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:23.735168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad98e68-6320-4b4c-95fe-497c2374d469 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:23.746272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad98e68-6320-4b4c-95fe-497c2374d469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-fad98e68-6320-4b4c-95fe-497c2374d469 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:23.753892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:23.755053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:23.755943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 548/1101] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:23.762000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd869d1-af9d-4675-a027-13a51811523f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:23.845253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:23.861030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd869d1-af9d-4675-a027-13a51811523f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:23.896105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7097481-aff5-4fe8-b896-f61d52bc7fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:23.896766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7097481-aff5-4fe8-b896-f61d52bc7fc2 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:23.897598 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7097481-aff5-4fe8-b896-f61d52bc7fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:23.897946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7097481-aff5-4fe8-b896-f61d52bc7fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:23.898692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7097481-aff5-4fe8-b896-f61d52bc7fc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:23.899004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7097481-aff5-4fe8-b896-f61d52bc7fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:23.900365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7097481-aff5-4fe8-b896-f61d52bc7fc2 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:23.908864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 554/1102] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:23.915293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad98e68-6320-4b4c-95fe-497c2374d469 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:23.981707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:24.029788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad98e68-6320-4b4c-95fe-497c2374d469 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:24.065997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88488f85-f2fb-4a34-8fab-cfcb777564f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:24.066891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88488f85-f2fb-4a34-8fab-cfcb777564f8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:24.067165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88488f85-f2fb-4a34-8fab-cfcb777564f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:24.067437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88488f85-f2fb-4a34-8fab-cfcb777564f8 None admin] PATH_INFO: `/v3/users/a5dce404a28d474ea0092cd67c3d3292` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:24.068636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88488f85-f2fb-4a34-8fab-cfcb777564f8 None admin] RBAC: Authorizing `identity:get_user(user_id=a5dce404a28d474ea0092cd67c3d3292)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:24.070808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88488f85-f2fb-4a34-8fab-cfcb777564f8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:24.072453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 549/1103] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:23 2022] GET /identity/v3/users/a5dce404a28d474ea0092cd67c3d3292 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:24.078224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7097481-aff5-4fe8-b896-f61d52bc7fc2 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:24.184551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7097481-aff5-4fe8-b896-f61d52bc7fc2 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:24.218994 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274352da-f9d4-4e03-80d5-1f19e3530543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:24.219639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274352da-f9d4-4e03-80d5-1f19e3530543 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:24.219918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274352da-f9d4-4e03-80d5-1f19e3530543 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:24.220192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274352da-f9d4-4e03-80d5-1f19e3530543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:24.238593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:24.289456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274352da-f9d4-4e03-80d5-1f19e3530543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:24.290870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274352da-f9d4-4e03-80d5-1f19e3530543 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:24.390305 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 555/1104] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:38:24.396325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88488f85-f2fb-4a34-8fab-cfcb777564f8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:24.504533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88488f85-f2fb-4a34-8fab-cfcb777564f8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:24.531098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:24.545452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3caa0-31df-4eb3-8a02-55c9c13c3b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:24.546330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3caa0-31df-4eb3-8a02-55c9c13c3b3e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:24.546626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3caa0-31df-4eb3-8a02-55c9c13c3b3e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:24.546978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3caa0-31df-4eb3-8a02-55c9c13c3b3e None admin] PATH_INFO: `/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:24.548203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3caa0-31df-4eb3-8a02-55c9c13c3b3e None admin] RBAC: Authorizing `identity:get_project(project_id=bc3e92eae5394f5281f7b682b2f0c2a5)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:24.549646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3caa0-31df-4eb3-8a02-55c9c13c3b3e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:24.551397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 550/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:24 2022] GET /identity/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:24.557883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274352da-f9d4-4e03-80d5-1f19e3530543 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:24.607083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:24.658699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274352da-f9d4-4e03-80d5-1f19e3530543 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:24.696192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aec14a-66f1-48ef-8e3f-347f072900c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:24.696860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec14a-66f1-48ef-8e3f-347f072900c0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:24.697125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec14a-66f1-48ef-8e3f-347f072900c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:24.697402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aec14a-66f1-48ef-8e3f-347f072900c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:24.698234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec14a-66f1-48ef-8e3f-347f072900c0 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=bc3e92eae5394f5281f7b682b2f0c2a5, user.id=a5dce404a28d474ea0092cd67c3d3292) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:24.698576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec14a-66f1-48ef-8e3f-347f072900c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:24.700028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aec14a-66f1-48ef-8e3f-347f072900c0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:24.706065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 556/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:24 2022] GET /identity/v3/role_assignments?user.id=a5dce404a28d474ea0092cd67c3d3292&scope.project.id=bc3e92eae5394f5281f7b682b2f0c2a5&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:26.818511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8f50-59ba-46ad-ade5-90125a8d57a1 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:26.819047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8f50-59ba-46ad-ade5-90125a8d57a1 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:26.819047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8f50-59ba-46ad-ade5-90125a8d57a1 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:26.820444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 551/1107] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:26.826624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12857-91b8-4fb8-b07f-067ac12eac29 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:26.827097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12857-91b8-4fb8-b07f-067ac12eac29 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:26.827197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12857-91b8-4fb8-b07f-067ac12eac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:26.844160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-5cd12857-91b8-4fb8-b07f-067ac12eac29 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:26.845375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5cd12857-91b8-4fb8-b07f-067ac12eac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:26.915229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 557/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:26.940962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8f50-59ba-46ad-ade5-90125a8d57a1 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:27.046419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8f50-59ba-46ad-ade5-90125a8d57a1 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:27.087542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b232078-1031-4409-b830-7f56e48e9690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:27.087542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b232078-1031-4409-b830-7f56e48e9690 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:27.087542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b232078-1031-4409-b830-7f56e48e9690 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:27.087542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b232078-1031-4409-b830-7f56e48e9690 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:27.091524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b232078-1031-4409-b830-7f56e48e9690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:27.091524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b232078-1031-4409-b830-7f56e48e9690 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:27.093205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 552/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:27.099349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12857-91b8-4fb8-b07f-067ac12eac29 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:27.145789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:27.204763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12857-91b8-4fb8-b07f-067ac12eac29 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:27.238900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab6d6a-35a8-4901-9cf0-6495d626453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:27.239567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab6d6a-35a8-4901-9cf0-6495d626453e None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:27.239847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab6d6a-35a8-4901-9cf0-6495d626453e None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:27.240121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab6d6a-35a8-4901-9cf0-6495d626453e None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:27.241400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab6d6a-35a8-4901-9cf0-6495d626453e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:27.243025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab6d6a-35a8-4901-9cf0-6495d626453e None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:27.264568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 558/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:38:27 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:29.369106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b545cc9-bcba-42e1-9603-63915502b1a9 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:29.369653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b545cc9-bcba-42e1-9603-63915502b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:29.369653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b545cc9-bcba-42e1-9603-63915502b1a9 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:29.371061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 553/1111] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:29.376589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a1c1-d22f-442c-821e-81312bc3a111 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:29.377073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a1c1-d22f-442c-821e-81312bc3a111 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:29.377178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127a1c1-d22f-442c-821e-81312bc3a111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:29.393742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e127a1c1-d22f-442c-821e-81312bc3a111 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:29.394977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e127a1c1-d22f-442c-821e-81312bc3a111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:29.468103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 559/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:29.493026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b545cc9-bcba-42e1-9603-63915502b1a9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:29.561218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:29.601873 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b545cc9-bcba-42e1-9603-63915502b1a9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:29.637196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b35b-dec6-404b-a292-472a6c56069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:29.637990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b35b-dec6-404b-a292-472a6c56069d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:29.638267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b35b-dec6-404b-a292-472a6c56069d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:29.638568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5b35b-dec6-404b-a292-472a6c56069d None admin] PATH_INFO: `/v3/roles/5e9864ab3b774da195d4d0b7282074ab` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:29.640035 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b35b-dec6-404b-a292-472a6c56069d None admin] RBAC: Authorizing `identity:get_role(role_id=5e9864ab3b774da195d4d0b7282074ab)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:29.641471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5b35b-dec6-404b-a292-472a6c56069d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:29.642892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 554/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:29 2022] GET /identity/v3/roles/5e9864ab3b774da195d4d0b7282074ab => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:29.649411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127a1c1-d22f-442c-821e-81312bc3a111 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:29.677898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:29.750156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127a1c1-d22f-442c-821e-81312bc3a111 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:29.784892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73fa6-bb1c-4ba7-8b18-98bc61113045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:29.785748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73fa6-bb1c-4ba7-8b18-98bc61113045 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:29.786024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73fa6-bb1c-4ba7-8b18-98bc61113045 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:29.786295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73fa6-bb1c-4ba7-8b18-98bc61113045 None admin] PATH_INFO: `/v3/users/e44ac827b0894f30a60847eeaa61eea6` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:29.800432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73fa6-bb1c-4ba7-8b18-98bc61113045 None admin] RBAC: Authorizing `identity:get_user(user_id=e44ac827b0894f30a60847eeaa61eea6)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:29.801878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73fa6-bb1c-4ba7-8b18-98bc61113045 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:29.803684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 560/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:29 2022] GET /identity/v3/users/e44ac827b0894f30a60847eeaa61eea6 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:29.809756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b35b-dec6-404b-a292-472a6c56069d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:29.918165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5b35b-dec6-404b-a292-472a6c56069d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:29.946689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:29.953021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161925d-95c3-426b-a0cf-785da1401ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:29.953661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161925d-95c3-426b-a0cf-785da1401ac3 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:29.953941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161925d-95c3-426b-a0cf-785da1401ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:29.954213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161925d-95c3-426b-a0cf-785da1401ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:30.032078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161925d-95c3-426b-a0cf-785da1401ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:30.033548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161925d-95c3-426b-a0cf-785da1401ac3 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:30.145806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 555/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:38:30.154607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73fa6-bb1c-4ba7-8b18-98bc61113045 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:30.236869 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:30.253717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73fa6-bb1c-4ba7-8b18-98bc61113045 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:30.286982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e498f86-007e-4c4c-863d-af31eaeb058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:30.289054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e498f86-007e-4c4c-863d-af31eaeb058a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:30.289341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e498f86-007e-4c4c-863d-af31eaeb058a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:30.289622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e498f86-007e-4c4c-863d-af31eaeb058a None admin] PATH_INFO: `/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:30.290864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e498f86-007e-4c4c-863d-af31eaeb058a None admin] RBAC: Authorizing `identity:get_project(project_id=bc3e92eae5394f5281f7b682b2f0c2a5)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:30.292340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e498f86-007e-4c4c-863d-af31eaeb058a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:30.294090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 561/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:30 2022] GET /identity/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:30.300401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161925d-95c3-426b-a0cf-785da1401ac3 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:30.333519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:30.419105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161925d-95c3-426b-a0cf-785da1401ac3 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:30.454122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e4aa2-072a-4d37-bea6-56aa61037dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:30.454802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e4aa2-072a-4d37-bea6-56aa61037dd8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:30.455086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e4aa2-072a-4d37-bea6-56aa61037dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:30.455367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e4aa2-072a-4d37-bea6-56aa61037dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:30.456200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e4aa2-072a-4d37-bea6-56aa61037dd8 None admin] RBAC: Adding query filter params (role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=bc3e92eae5394f5281f7b682b2f0c2a5, user.id=e44ac827b0894f30a60847eeaa61eea6) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:30.456516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e4aa2-072a-4d37-bea6-56aa61037dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:30.457967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e4aa2-072a-4d37-bea6-56aa61037dd8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:30.464559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 556/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:30 2022] GET /identity/v3/role_assignments?user.id=e44ac827b0894f30a60847eeaa61eea6&scope.project.id=bc3e92eae5394f5281f7b682b2f0c2a5&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:32.490881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753c8a4-9a08-4126-b2bf-bf8175a5e81c None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:32.491449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753c8a4-9a08-4126-b2bf-bf8175a5e81c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:32.491449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753c8a4-9a08-4126-b2bf-bf8175a5e81c None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:32.492830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 562/1118] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:32.499238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd51bf-0ef9-49de-bfb1-0cfc9572a76d None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:32.499749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd51bf-0ef9-49de-bfb1-0cfc9572a76d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:32.499870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd51bf-0ef9-49de-bfb1-0cfc9572a76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:32.516535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ddbd51bf-0ef9-49de-bfb1-0cfc9572a76d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:32.517735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ddbd51bf-0ef9-49de-bfb1-0cfc9572a76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:32.589081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 557/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:32.611955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753c8a4-9a08-4126-b2bf-bf8175a5e81c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:32.717262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753c8a4-9a08-4126-b2bf-bf8175a5e81c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:32.751447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3fa5c-265f-4732-b182-5697d34220b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:32.752215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3fa5c-265f-4732-b182-5697d34220b0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:32.752491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3fa5c-265f-4732-b182-5697d34220b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:32.752767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3fa5c-265f-4732-b182-5697d34220b0 None admin] PATH_INFO: `/v3/roles/5e9864ab3b774da195d4d0b7282074ab` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:32.754233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3fa5c-265f-4732-b182-5697d34220b0 None admin] RBAC: Authorizing `identity:get_role(role_id=5e9864ab3b774da195d4d0b7282074ab)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:32.755630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3fa5c-265f-4732-b182-5697d34220b0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:32.757004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 563/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:32 2022] GET /identity/v3/roles/5e9864ab3b774da195d4d0b7282074ab => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:32.763064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd51bf-0ef9-49de-bfb1-0cfc9572a76d None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:32.787458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:32.862799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd51bf-0ef9-49de-bfb1-0cfc9572a76d None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:32.897849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081cf58-2b66-4dcc-933a-8b18a7d5a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:32.898740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081cf58-2b66-4dcc-933a-8b18a7d5a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:32.899044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081cf58-2b66-4dcc-933a-8b18a7d5a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:32.899288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081cf58-2b66-4dcc-933a-8b18a7d5a2a1 None admin] PATH_INFO: `/v3/users/e44ac827b0894f30a60847eeaa61eea6` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:32.900503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081cf58-2b66-4dcc-933a-8b18a7d5a2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=e44ac827b0894f30a60847eeaa61eea6)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:32.901940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081cf58-2b66-4dcc-933a-8b18a7d5a2a1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:32.903600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 558/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:32 2022] GET /identity/v3/users/e44ac827b0894f30a60847eeaa61eea6 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:32.909514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3fa5c-265f-4732-b182-5697d34220b0 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:32.934458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:33.012997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3fa5c-265f-4732-b182-5697d34220b0 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:33.050285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8473ec3-ad17-42dd-a692-dbbc4651436c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:33.051175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473ec3-ad17-42dd-a692-dbbc4651436c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:33.051457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473ec3-ad17-42dd-a692-dbbc4651436c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:33.051732 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8473ec3-ad17-42dd-a692-dbbc4651436c None admin] PATH_INFO: `/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:33.052923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8473ec3-ad17-42dd-a692-dbbc4651436c None admin] RBAC: Authorizing `identity:get_project(project_id=bc3e92eae5394f5281f7b682b2f0c2a5)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:33.054993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8473ec3-ad17-42dd-a692-dbbc4651436c None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:33.056715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 564/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:32 2022] GET /identity/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:33.062707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081cf58-2b66-4dcc-933a-8b18a7d5a2a1 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:33.164719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:33.173708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081cf58-2b66-4dcc-933a-8b18a7d5a2a1 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:33.210981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ef9a-faf8-4942-9103-136bee3cf6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:33.211869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ef9a-faf8-4942-9103-136bee3cf6e5 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:33.212147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ef9a-faf8-4942-9103-136bee3cf6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:33.212419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ef9a-faf8-4942-9103-136bee3cf6e5 None admin] PATH_INFO: `/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5/users/e44ac827b0894f30a60847eeaa61eea6/roles/5e9864ab3b774da195d4d0b7282074ab` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:33.214674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ef9a-faf8-4942-9103-136bee3cf6e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc3e92eae5394f5281f7b682b2f0c2a5, user_id=e44ac827b0894f30a60847eeaa61eea6, role_id=5e9864ab3b774da195d4d0b7282074ab)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:33.216111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ef9a-faf8-4942-9103-136bee3cf6e5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:33.229245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 559/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:33 2022] PUT /identity/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5/users/e44ac827b0894f30a60847eeaa61eea6/roles/5e9864ab3b774da195d4d0b7282074ab => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:38:35.288449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc392-6e1e-4520-b770-6f632a181b15 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.289014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc392-6e1e-4520-b770-6f632a181b15 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.289014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadc392-6e1e-4520-b770-6f632a181b15 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.291046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 565/1124] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:35.296593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dff98-4dad-40f4-a7a6-502713775620 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.297057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dff98-4dad-40f4-a7a6-502713775620 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.297169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065dff98-4dad-40f4-a7a6-502713775620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.314558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-065dff98-4dad-40f4-a7a6-502713775620 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:35.316028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-065dff98-4dad-40f4-a7a6-502713775620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:35.385552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 560/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:35.412238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadc392-6e1e-4520-b770-6f632a181b15 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.511593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:35.524539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadc392-6e1e-4520-b770-6f632a181b15 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:35.560721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba0933-6aec-4d6b-a866-9ee31efd8c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:35.561582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba0933-6aec-4d6b-a866-9ee31efd8c2a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.561866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba0933-6aec-4d6b-a866-9ee31efd8c2a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.562146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba0933-6aec-4d6b-a866-9ee31efd8c2a None admin] PATH_INFO: `/v3/roles/5e9864ab3b774da195d4d0b7282074ab` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.563842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba0933-6aec-4d6b-a866-9ee31efd8c2a None admin] RBAC: Authorizing `identity:get_role(role_id=5e9864ab3b774da195d4d0b7282074ab)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:35.565226 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba0933-6aec-4d6b-a866-9ee31efd8c2a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:35.566921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 566/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/roles/5e9864ab3b774da195d4d0b7282074ab => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:35.573385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dff98-4dad-40f4-a7a6-502713775620 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.661069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:35.682982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065dff98-4dad-40f4-a7a6-502713775620 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:35.719254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f45d09-79d3-4d78-b05a-259e9627ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:35.720125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f45d09-79d3-4d78-b05a-259e9627ac04 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.720409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f45d09-79d3-4d78-b05a-259e9627ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.720689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f45d09-79d3-4d78-b05a-259e9627ac04 None admin] PATH_INFO: `/v3/users/e44ac827b0894f30a60847eeaa61eea6` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.721887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f45d09-79d3-4d78-b05a-259e9627ac04 None admin] RBAC: Authorizing `identity:get_user(user_id=e44ac827b0894f30a60847eeaa61eea6)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:35.723372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f45d09-79d3-4d78-b05a-259e9627ac04 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:35.725895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 561/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/users/e44ac827b0894f30a60847eeaa61eea6 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:35.731554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba0933-6aec-4d6b-a866-9ee31efd8c2a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:35.831175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba0933-6aec-4d6b-a866-9ee31efd8c2a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:35.866099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200b1af-874d-49d2-a915-e8dfe2c2c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:35.866783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200b1af-874d-49d2-a915-e8dfe2c2c3db None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:35.867071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200b1af-874d-49d2-a915-e8dfe2c2c3db None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:35.867350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200b1af-874d-49d2-a915-e8dfe2c2c3db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:35.893984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:35.937506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200b1af-874d-49d2-a915-e8dfe2c2c3db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:35.938998 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200b1af-874d-49d2-a915-e8dfe2c2c3db None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:36.041831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 567/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:38:36.047766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f45d09-79d3-4d78-b05a-259e9627ac04 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:36.148258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f45d09-79d3-4d78-b05a-259e9627ac04 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:36.183508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307759b-46e3-4103-a879-8f5294b90d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:36.184362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307759b-46e3-4103-a879-8f5294b90d04 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:36.184645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307759b-46e3-4103-a879-8f5294b90d04 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:36.184921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307759b-46e3-4103-a879-8f5294b90d04 None admin] PATH_INFO: `/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:36.186104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307759b-46e3-4103-a879-8f5294b90d04 None admin] RBAC: Authorizing `identity:get_project(project_id=bc3e92eae5394f5281f7b682b2f0c2a5)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:36.187568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307759b-46e3-4103-a879-8f5294b90d04 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:36.189281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 562/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:36 2022] GET /identity/v3/projects/bc3e92eae5394f5281f7b682b2f0c2a5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:36.195983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200b1af-874d-49d2-a915-e8dfe2c2c3db None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:36.255690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:36.299746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200b1af-874d-49d2-a915-e8dfe2c2c3db None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:36.335798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc65523-bf51-4517-80cf-71678a517d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:36.336919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc65523-bf51-4517-80cf-71678a517d9a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:36.337414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc65523-bf51-4517-80cf-71678a517d9a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:36.337702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc65523-bf51-4517-80cf-71678a517d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:36.338578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc65523-bf51-4517-80cf-71678a517d9a None admin] RBAC: Adding query filter params (role.id=5e9864ab3b774da195d4d0b7282074ab, scope.project.id=bc3e92eae5394f5281f7b682b2f0c2a5, user.id=e44ac827b0894f30a60847eeaa61eea6) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:36.338900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc65523-bf51-4517-80cf-71678a517d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:36.340346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc65523-bf51-4517-80cf-71678a517d9a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:36.347375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 568/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:36 2022] GET /identity/v3/role_assignments?user.id=e44ac827b0894f30a60847eeaa61eea6&scope.project.id=bc3e92eae5394f5281f7b682b2f0c2a5&role.id=5e9864ab3b774da195d4d0b7282074ab => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:38.425677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081acf1a-c793-4717-95d3-6109d9cea68e None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:38.426213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081acf1a-c793-4717-95d3-6109d9cea68e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:38.426213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081acf1a-c793-4717-95d3-6109d9cea68e None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:38.427629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 563/1131] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:38.433644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4223a-a4cf-4d3b-8cd7-2e241f232bc4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:38.434206 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4223a-a4cf-4d3b-8cd7-2e241f232bc4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:38.434206 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4223a-a4cf-4d3b-8cd7-2e241f232bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:38.451119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-41c4223a-a4cf-4d3b-8cd7-2e241f232bc4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:38.452305 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-41c4223a-a4cf-4d3b-8cd7-2e241f232bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:38.521435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 569/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:38.545668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081acf1a-c793-4717-95d3-6109d9cea68e None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:38.565848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:38.652150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081acf1a-c793-4717-95d3-6109d9cea68e None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:38.689277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95811081-9ce2-4c77-a0a6-ee8c6ebc4c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:38.689978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95811081-9ce2-4c77-a0a6-ee8c6ebc4c50 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:38.690295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95811081-9ce2-4c77-a0a6-ee8c6ebc4c50 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:38.690861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95811081-9ce2-4c77-a0a6-ee8c6ebc4c50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:38.692067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95811081-9ce2-4c77-a0a6-ee8c6ebc4c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:38.693501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95811081-9ce2-4c77-a0a6-ee8c6ebc4c50 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:38.695526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 564/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:38:38.701360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4223a-a4cf-4d3b-8cd7-2e241f232bc4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:38.756423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:38.809720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4223a-a4cf-4d3b-8cd7-2e241f232bc4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:38.844515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb1562-406d-4253-8581-c4ac811483e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:38.845169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb1562-406d-4253-8581-c4ac811483e9 None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:38.845453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb1562-406d-4253-8581-c4ac811483e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:38.845734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb1562-406d-4253-8581-c4ac811483e9 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:38.846494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb1562-406d-4253-8581-c4ac811483e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:38.848072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb1562-406d-4253-8581-c4ac811483e9 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:38.874253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 570/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:38:38 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:38:40.953517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded6f6d-f84b-4bf9-9888-b26757b5cba2 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.954051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded6f6d-f84b-4bf9-9888-b26757b5cba2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.954051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded6f6d-f84b-4bf9-9888-b26757b5cba2 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.955459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 565/1135] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:40.961680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c20877-e9a9-4d2b-8e23-4e9acd2e6238 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:40.962150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c20877-e9a9-4d2b-8e23-4e9acd2e6238 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:40.962242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c20877-e9a9-4d2b-8e23-4e9acd2e6238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:40.980301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-64c20877-e9a9-4d2b-8e23-4e9acd2e6238 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:40.981505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-64c20877-e9a9-4d2b-8e23-4e9acd2e6238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:41.052757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 571/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:41.078127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded6f6d-f84b-4bf9-9888-b26757b5cba2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:41.179446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:41.196257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded6f6d-f84b-4bf9-9888-b26757b5cba2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:41.231475 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e0668-f03a-4f92-9ff5-769cdc48b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:41.232176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e0668-f03a-4f92-9ff5-769cdc48b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:41.232456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e0668-f03a-4f92-9ff5-769cdc48b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:41.232728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e0668-f03a-4f92-9ff5-769cdc48b5d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:41.233901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e0668-f03a-4f92-9ff5-769cdc48b5d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:41.235362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e0668-f03a-4f92-9ff5-769cdc48b5d3 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:41.236980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 566/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:38:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:41.243579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c20877-e9a9-4d2b-8e23-4e9acd2e6238 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:41.277251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:41.345754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c20877-e9a9-4d2b-8e23-4e9acd2e6238 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:41.380506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4924a-755b-444a-b890-33fa96b1badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:41.381735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4924a-755b-444a-b890-33fa96b1badd None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:41.382015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4924a-755b-444a-b890-33fa96b1badd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:41.382286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4924a-755b-444a-b890-33fa96b1badd None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:41.383034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4924a-755b-444a-b890-33fa96b1badd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:41.384447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4924a-755b-444a-b890-33fa96b1badd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:41.405025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 572/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:38:41 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:43.496058 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56c0bb-5d83-4b8b-ba1d-4adc52c3958b None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:43.496619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56c0bb-5d83-4b8b-ba1d-4adc52c3958b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:43.496619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56c0bb-5d83-4b8b-ba1d-4adc52c3958b None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:43.497995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 567/1139] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:43.503733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dd3b4-1e7f-41a7-9c9c-d4b9e219f1cb None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:43.504194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dd3b4-1e7f-41a7-9c9c-d4b9e219f1cb None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:43.504304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365dd3b4-1e7f-41a7-9c9c-d4b9e219f1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:43.521193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-365dd3b4-1e7f-41a7-9c9c-d4b9e219f1cb None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:43.522444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-365dd3b4-1e7f-41a7-9c9c-d4b9e219f1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:43.597317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 573/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:43.622110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56c0bb-5d83-4b8b-ba1d-4adc52c3958b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:43.729864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56c0bb-5d83-4b8b-ba1d-4adc52c3958b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:43.764943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3026-8ead-4f4c-96c7-50c0c0644237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:43.765337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3026-8ead-4f4c-96c7-50c0c0644237 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:43.765599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3026-8ead-4f4c-96c7-50c0c0644237 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:43.765873 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3026-8ead-4f4c-96c7-50c0c0644237 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:43.776708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c3026-8ead-4f4c-96c7-50c0c0644237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-926c3026-8ead-4f4c-96c7-50c0c0644237 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:43.791804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:43.792831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:43.793696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 568/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:43.799308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dd3b4-1e7f-41a7-9c9c-d4b9e219f1cb None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:43.821322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:43.899109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365dd3b4-1e7f-41a7-9c9c-d4b9e219f1cb None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:43.936122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93205-9308-4d9e-b76d-928499f6fc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:43.936782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93205-9308-4d9e-b76d-928499f6fc18 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:43.937064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93205-9308-4d9e-b76d-928499f6fc18 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:43.937340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93205-9308-4d9e-b76d-928499f6fc18 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:43.938091 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a93205-9308-4d9e-b76d-928499f6fc18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:43.938423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a93205-9308-4d9e-b76d-928499f6fc18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:43.939800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a93205-9308-4d9e-b76d-928499f6fc18 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:43.949387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 574/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:43.955332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3026-8ead-4f4c-96c7-50c0c0644237 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:43.972990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:44.065002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3026-8ead-4f4c-96c7-50c0c0644237 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:44.099716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043821d-e355-48cd-832c-60418ae471e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:44.101400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043821d-e355-48cd-832c-60418ae471e7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:44.101690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043821d-e355-48cd-832c-60418ae471e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:44.101974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043821d-e355-48cd-832c-60418ae471e7 None admin] PATH_INFO: `/v3/users/877c50a2c5ab4de98054c96a74b46562` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:44.119960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043821d-e355-48cd-832c-60418ae471e7 None admin] RBAC: Authorizing `identity:get_user(user_id=877c50a2c5ab4de98054c96a74b46562)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:44.121433 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043821d-e355-48cd-832c-60418ae471e7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:44.123224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 569/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:43 2022] GET /identity/v3/users/877c50a2c5ab4de98054c96a74b46562 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:44.129109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93205-9308-4d9e-b76d-928499f6fc18 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:44.218127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:44.238164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93205-9308-4d9e-b76d-928499f6fc18 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:44.274694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46417931-de04-4639-b312-1c0d5a3c5bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:44.275337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46417931-de04-4639-b312-1c0d5a3c5bab None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:44.275617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46417931-de04-4639-b312-1c0d5a3c5bab None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:44.275887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46417931-de04-4639-b312-1c0d5a3c5bab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:44.343159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46417931-de04-4639-b312-1c0d5a3c5bab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:44.344504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46417931-de04-4639-b312-1c0d5a3c5bab None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:44.427508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:44.447723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 575/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:38:44.453642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043821d-e355-48cd-832c-60418ae471e7 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:44.528108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:44.560435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043821d-e355-48cd-832c-60418ae471e7 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:44.600511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e09ef-cec5-459b-b4bb-c5b3f9665498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:44.601281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e09ef-cec5-459b-b4bb-c5b3f9665498 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:44.601559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e09ef-cec5-459b-b4bb-c5b3f9665498 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:44.601834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e09ef-cec5-459b-b4bb-c5b3f9665498 None admin] PATH_INFO: `/v3/projects/07cfd58324d64aed893a174585c73dbb` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:44.603057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e09ef-cec5-459b-b4bb-c5b3f9665498 None admin] RBAC: Authorizing `identity:get_project(project_id=07cfd58324d64aed893a174585c73dbb)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:44.604494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e09ef-cec5-459b-b4bb-c5b3f9665498 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:44.606217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 570/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:44 2022] GET /identity/v3/projects/07cfd58324d64aed893a174585c73dbb => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:44.612310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46417931-de04-4639-b312-1c0d5a3c5bab None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:44.714483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46417931-de04-4639-b312-1c0d5a3c5bab None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:44.748679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c5e18-7e06-4be8-aa5c-13e70da0752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:44.749330 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c5e18-7e06-4be8-aa5c-13e70da0752d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:44.749610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c5e18-7e06-4be8-aa5c-13e70da0752d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:44.749885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c5e18-7e06-4be8-aa5c-13e70da0752d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:44.750741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c5e18-7e06-4be8-aa5c-13e70da0752d None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=07cfd58324d64aed893a174585c73dbb, user.id=877c50a2c5ab4de98054c96a74b46562) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:44.751051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c5e18-7e06-4be8-aa5c-13e70da0752d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:44.752490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c5e18-7e06-4be8-aa5c-13e70da0752d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:44.759068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 576/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:44 2022] GET /identity/v3/role_assignments?user.id=877c50a2c5ab4de98054c96a74b46562&scope.project.id=07cfd58324d64aed893a174585c73dbb&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:46.853365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64d8c8-210a-4c94-86d4-ee47b64ec188 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:46.853976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64d8c8-210a-4c94-86d4-ee47b64ec188 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:46.853976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64d8c8-210a-4c94-86d4-ee47b64ec188 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:46.855325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 571/1147] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:46.860914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93abd89-9cb0-40c6-9eb2-d8d8bbd0d318 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:46.861409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93abd89-9cb0-40c6-9eb2-d8d8bbd0d318 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:46.861508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93abd89-9cb0-40c6-9eb2-d8d8bbd0d318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:46.879320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a93abd89-9cb0-40c6-9eb2-d8d8bbd0d318 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:46.880520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a93abd89-9cb0-40c6-9eb2-d8d8bbd0d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:46.924801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:46.950369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 577/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:46.975818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64d8c8-210a-4c94-86d4-ee47b64ec188 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:47.081717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64d8c8-210a-4c94-86d4-ee47b64ec188 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:47.119263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6265b79-750e-4328-86e4-4ec7ed01e7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:47.119971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6265b79-750e-4328-86e4-4ec7ed01e7fc None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:47.120248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6265b79-750e-4328-86e4-4ec7ed01e7fc None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:47.120518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6265b79-750e-4328-86e4-4ec7ed01e7fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:47.130607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:47.134026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6265b79-750e-4328-86e4-4ec7ed01e7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-e6265b79-750e-4328-86e4-4ec7ed01e7fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:47.141989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:47.143236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:47.144354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 572/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:47.149992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93abd89-9cb0-40c6-9eb2-d8d8bbd0d318 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:47.251388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93abd89-9cb0-40c6-9eb2-d8d8bbd0d318 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:47.286138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8f5f6-4f8f-4e1b-91e0-4cc123a7e203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:47.286834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8f5f6-4f8f-4e1b-91e0-4cc123a7e203 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:47.287119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8f5f6-4f8f-4e1b-91e0-4cc123a7e203 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:47.287466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8f5f6-4f8f-4e1b-91e0-4cc123a7e203 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:47.288223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8f5f6-4f8f-4e1b-91e0-4cc123a7e203 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:47.288535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8f5f6-4f8f-4e1b-91e0-4cc123a7e203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:47.289918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8f5f6-4f8f-4e1b-91e0-4cc123a7e203 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:47.298534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 578/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:47.304668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6265b79-750e-4328-86e4-4ec7ed01e7fc None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:47.416876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6265b79-750e-4328-86e4-4ec7ed01e7fc None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:47.452466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fc6bc-d153-4cda-bdc9-3195024ea8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:47.453343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fc6bc-d153-4cda-bdc9-3195024ea8ca None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:47.453630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fc6bc-d153-4cda-bdc9-3195024ea8ca None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:47.453908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fc6bc-d153-4cda-bdc9-3195024ea8ca None admin] PATH_INFO: `/v3/users/877c50a2c5ab4de98054c96a74b46562` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:47.455143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fc6bc-d153-4cda-bdc9-3195024ea8ca None admin] RBAC: Authorizing `identity:get_user(user_id=877c50a2c5ab4de98054c96a74b46562)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:47.456589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021fc6bc-d153-4cda-bdc9-3195024ea8ca None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:47.458251 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 573/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:47 2022] GET /identity/v3/users/877c50a2c5ab4de98054c96a74b46562 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:47.464876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8f5f6-4f8f-4e1b-91e0-4cc123a7e203 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:47.514247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:47.576126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8f5f6-4f8f-4e1b-91e0-4cc123a7e203 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:47.610246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb16775-77ec-41c8-a49b-580dc5ad7b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:47.611146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb16775-77ec-41c8-a49b-580dc5ad7b6c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:47.611434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb16775-77ec-41c8-a49b-580dc5ad7b6c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:47.611717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb16775-77ec-41c8-a49b-580dc5ad7b6c None admin] PATH_INFO: `/v3/projects/07cfd58324d64aed893a174585c73dbb` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:47.612913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb16775-77ec-41c8-a49b-580dc5ad7b6c None admin] RBAC: Authorizing `identity:get_project(project_id=07cfd58324d64aed893a174585c73dbb)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:47.614381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb16775-77ec-41c8-a49b-580dc5ad7b6c None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:47.616884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 579/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:47 2022] GET /identity/v3/projects/07cfd58324d64aed893a174585c73dbb => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:47.622947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fc6bc-d153-4cda-bdc9-3195024ea8ca None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:47.693564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:47.730401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021fc6bc-d153-4cda-bdc9-3195024ea8ca None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:47.764121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2505cd9-3680-4f8d-8a2b-65c194ca5bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:47.765008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2505cd9-3680-4f8d-8a2b-65c194ca5bf4 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:47.765289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2505cd9-3680-4f8d-8a2b-65c194ca5bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:47.765570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2505cd9-3680-4f8d-8a2b-65c194ca5bf4 None admin] PATH_INFO: `/v3/projects/07cfd58324d64aed893a174585c73dbb/users/877c50a2c5ab4de98054c96a74b46562/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:47.767658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2505cd9-3680-4f8d-8a2b-65c194ca5bf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=07cfd58324d64aed893a174585c73dbb, user_id=877c50a2c5ab4de98054c96a74b46562, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:47.769110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2505cd9-3680-4f8d-8a2b-65c194ca5bf4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:47.783697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 574/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:38:47 2022] PUT /identity/v3/projects/07cfd58324d64aed893a174585c73dbb/users/877c50a2c5ab4de98054c96a74b46562/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:38:49.909826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b130c5-6ab8-48cc-aa87-d42a3686f78c None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.910417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b130c5-6ab8-48cc-aa87-d42a3686f78c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.910417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b130c5-6ab8-48cc-aa87-d42a3686f78c None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.911791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 580/1154] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:49.918523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf06a29-afc8-453c-8094-c2716f6d818b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:49.918998 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf06a29-afc8-453c-8094-c2716f6d818b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:49.919098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf06a29-afc8-453c-8094-c2716f6d818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:49.935865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3bf06a29-afc8-453c-8094-c2716f6d818b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:49.937075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3bf06a29-afc8-453c-8094-c2716f6d818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:50.006249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 575/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:50.030871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b130c5-6ab8-48cc-aa87-d42a3686f78c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.141065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b130c5-6ab8-48cc-aa87-d42a3686f78c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.148577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.182416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236e6df-5572-400c-a075-2913f5979510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.183134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236e6df-5572-400c-a075-2913f5979510 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.183420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236e6df-5572-400c-a075-2913f5979510 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.183701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236e6df-5572-400c-a075-2913f5979510 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.194626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236e6df-5572-400c-a075-2913f5979510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-4236e6df-5572-400c-a075-2913f5979510 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:38:50.202173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:50.203244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:38:50.204217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 581/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:50.210217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf06a29-afc8-453c-8094-c2716f6d818b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.270460 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.316424 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf06a29-afc8-453c-8094-c2716f6d818b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.352309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10626cf-c255-460a-8050-f2917a8c4e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.352976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10626cf-c255-460a-8050-f2917a8c4e3f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.353261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10626cf-c255-460a-8050-f2917a8c4e3f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.353538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10626cf-c255-460a-8050-f2917a8c4e3f None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.354289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10626cf-c255-460a-8050-f2917a8c4e3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:50.354631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10626cf-c255-460a-8050-f2917a8c4e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.356016 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10626cf-c255-460a-8050-f2917a8c4e3f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.364441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 576/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:50.371119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236e6df-5572-400c-a075-2913f5979510 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.473383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236e6df-5572-400c-a075-2913f5979510 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.507952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee6120-a87d-4918-a51f-d5c2c4afd137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.508824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee6120-a87d-4918-a51f-d5c2c4afd137 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.509109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee6120-a87d-4918-a51f-d5c2c4afd137 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.509393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee6120-a87d-4918-a51f-d5c2c4afd137 None admin] PATH_INFO: `/v3/users/877c50a2c5ab4de98054c96a74b46562` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.510624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee6120-a87d-4918-a51f-d5c2c4afd137 None admin] RBAC: Authorizing `identity:get_user(user_id=877c50a2c5ab4de98054c96a74b46562)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.512061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee6120-a87d-4918-a51f-d5c2c4afd137 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.513702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 582/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/users/877c50a2c5ab4de98054c96a74b46562 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:50.519892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10626cf-c255-460a-8050-f2917a8c4e3f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.625673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10626cf-c255-460a-8050-f2917a8c4e3f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.651030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.665927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887d1c0-4080-47fb-840f-25e818608027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.666601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d1c0-4080-47fb-840f-25e818608027 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.666885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d1c0-4080-47fb-840f-25e818608027 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.667160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887d1c0-4080-47fb-840f-25e818608027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.738557 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887d1c0-4080-47fb-840f-25e818608027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.739937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887d1c0-4080-47fb-840f-25e818608027 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.845525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 577/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:38:50.852889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee6120-a87d-4918-a51f-d5c2c4afd137 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:50.887903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:50.957267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee6120-a87d-4918-a51f-d5c2c4afd137 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:50.992973 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9789540-4ad7-483f-871c-a0e0a8701a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:50.993750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9789540-4ad7-483f-871c-a0e0a8701a27 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:50.994035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9789540-4ad7-483f-871c-a0e0a8701a27 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:50.994344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9789540-4ad7-483f-871c-a0e0a8701a27 None admin] PATH_INFO: `/v3/projects/07cfd58324d64aed893a174585c73dbb` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:50.995546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9789540-4ad7-483f-871c-a0e0a8701a27 None admin] RBAC: Authorizing `identity:get_project(project_id=07cfd58324d64aed893a174585c73dbb)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:50.996985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9789540-4ad7-483f-871c-a0e0a8701a27 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:50.998719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 583/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:38:50 2022] GET /identity/v3/projects/07cfd58324d64aed893a174585c73dbb => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:51.004835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887d1c0-4080-47fb-840f-25e818608027 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:51.028000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:51.108533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887d1c0-4080-47fb-840f-25e818608027 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:51.144190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23fbc1-b7b0-422c-83dd-1c5b386bfea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:51.144847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23fbc1-b7b0-422c-83dd-1c5b386bfea3 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:51.145131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23fbc1-b7b0-422c-83dd-1c5b386bfea3 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:51.145407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23fbc1-b7b0-422c-83dd-1c5b386bfea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:51.146231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23fbc1-b7b0-422c-83dd-1c5b386bfea3 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=07cfd58324d64aed893a174585c73dbb, user.id=877c50a2c5ab4de98054c96a74b46562) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:51.147186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23fbc1-b7b0-422c-83dd-1c5b386bfea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:51.148725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23fbc1-b7b0-422c-83dd-1c5b386bfea3 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:51.154916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 578/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:38:51 2022] GET /identity/v3/role_assignments?user.id=877c50a2c5ab4de98054c96a74b46562&scope.project.id=07cfd58324d64aed893a174585c73dbb&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:53.236573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989df43-e15c-400c-a06d-05f7f7166582 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:53.237146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989df43-e15c-400c-a06d-05f7f7166582 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:53.237146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989df43-e15c-400c-a06d-05f7f7166582 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:53.238516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 584/1162] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:53.244749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175079-6dc3-455e-a016-b39f0ca39f3a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:53.245263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175079-6dc3-455e-a016-b39f0ca39f3a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:53.245380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3175079-6dc3-455e-a016-b39f0ca39f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:53.263211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-e3175079-6dc3-455e-a016-b39f0ca39f3a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:53.264428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e3175079-6dc3-455e-a016-b39f0ca39f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:53.336280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 579/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:53.359722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989df43-e15c-400c-a06d-05f7f7166582 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:53.467522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989df43-e15c-400c-a06d-05f7f7166582 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:53.469061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:53.501178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877decbc-2e4e-4816-8d5a-dba1d51f7dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:53.501734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877decbc-2e4e-4816-8d5a-dba1d51f7dc6 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:53.502017 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877decbc-2e4e-4816-8d5a-dba1d51f7dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:53.502295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877decbc-2e4e-4816-8d5a-dba1d51f7dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:53.574531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877decbc-2e4e-4816-8d5a-dba1d51f7dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:53.576014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877decbc-2e4e-4816-8d5a-dba1d51f7dc6 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:53.679541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 585/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:38:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:38:53.685590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3175079-6dc3-455e-a016-b39f0ca39f3a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:53.701726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:53.788422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3175079-6dc3-455e-a016-b39f0ca39f3a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:53.823708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f5bc3-59e5-4af5-a345-caa7069eed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:53.824504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5bc3-59e5-4af5-a345-caa7069eed51 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:53.824789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5bc3-59e5-4af5-a345-caa7069eed51 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:53.825062 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5bc3-59e5-4af5-a345-caa7069eed51 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:53.832233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5bc3-59e5-4af5-a345-caa7069eed51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:53.833687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5bc3-59e5-4af5-a345-caa7069eed51 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-308f5bc3-59e5-4af5-a345-caa7069eed51 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:38:53.848516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:38:53.850538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:38:53.851490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 580/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:38:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:38:53.856789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877decbc-2e4e-4816-8d5a-dba1d51f7dc6 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:53.859008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:53.957912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877decbc-2e4e-4816-8d5a-dba1d51f7dc6 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:53.994530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0ca80-27d3-4389-88ea-93dc98bbe9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:53.995185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0ca80-27d3-4389-88ea-93dc98bbe9cd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:53.995467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0ca80-27d3-4389-88ea-93dc98bbe9cd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:53.995746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0ca80-27d3-4389-88ea-93dc98bbe9cd None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:53.996471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0ca80-27d3-4389-88ea-93dc98bbe9cd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:38:53.996778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0ca80-27d3-4389-88ea-93dc98bbe9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:53.998141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0ca80-27d3-4389-88ea-93dc98bbe9cd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:54.005468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 586/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jun 23 10:38:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:56.067063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cfcec-9deb-4c07-989a-65747f2f3a1e None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.067630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cfcec-9deb-4c07-989a-65747f2f3a1e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.067630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cfcec-9deb-4c07-989a-65747f2f3a1e None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.069564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 581/1167] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:38:56.075112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3609e1-4dd8-40d7-9f86-9a4e3774583d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.075589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3609e1-4dd8-40d7-9f86-9a4e3774583d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.075680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3609e1-4dd8-40d7-9f86-9a4e3774583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.092758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-cd3609e1-4dd8-40d7-9f86-9a4e3774583d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:56.093961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-cd3609e1-4dd8-40d7-9f86-9a4e3774583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:56.163142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:56.173576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 587/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:56.196992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cfcec-9deb-4c07-989a-65747f2f3a1e None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:56.275827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:56.308984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cfcec-9deb-4c07-989a-65747f2f3a1e None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:56.344310 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e34ce-56c1-4f2c-beb4-7e098baf3b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:56.344882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e34ce-56c1-4f2c-beb4-7e098baf3b60 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:56.345161 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e34ce-56c1-4f2c-beb4-7e098baf3b60 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:56.345437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e34ce-56c1-4f2c-beb4-7e098baf3b60 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:56.346178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e34ce-56c1-4f2c-beb4-7e098baf3b60 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:56.347587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e34ce-56c1-4f2c-beb4-7e098baf3b60 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:56.362992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 582/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Thu Jun 23 10:38:56 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:38:58.432183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac33458-5bb2-4071-ba94-c6598495d71d None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.432729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac33458-5bb2-4071-ba94-c6598495d71d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.432729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac33458-5bb2-4071-ba94-c6598495d71d None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.434102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 588/1170] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:38:58.439538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62730ae1-1da4-4cb9-85a4-6cedfae05049 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.440003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62730ae1-1da4-4cb9-85a4-6cedfae05049 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.440097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62730ae1-1da4-4cb9-85a4-6cedfae05049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.457189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-62730ae1-1da4-4cb9-85a4-6cedfae05049 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:38:58.458412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-62730ae1-1da4-4cb9-85a4-6cedfae05049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:38:58.527623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 583/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:38:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:38:58.551502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac33458-5bb2-4071-ba94-c6598495d71d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:58.657795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac33458-5bb2-4071-ba94-c6598495d71d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:58.691864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b6ddf-0a76-455e-91d5-8264eb4ed7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:58.692631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b6ddf-0a76-455e-91d5-8264eb4ed7b3 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.692914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b6ddf-0a76-455e-91d5-8264eb4ed7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.693439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b6ddf-0a76-455e-91d5-8264eb4ed7b3 None admin] PATH_INFO: `/v3/domains/0dc715bfb3f44cf5882f7e8f339a053b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.704611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b6ddf-0a76-455e-91d5-8264eb4ed7b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0dc715bfb3f44cf5882f7e8f339a053b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:58.706069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b6ddf-0a76-455e-91d5-8264eb4ed7b3 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:58.707816 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 589/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jun 23 10:38:58 2022] GET /identity/v3/domains/0dc715bfb3f44cf5882f7e8f339a053b => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:38:58.714350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62730ae1-1da4-4cb9-85a4-6cedfae05049 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:38:58.782650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:38:58.829806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62730ae1-1da4-4cb9-85a4-6cedfae05049 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:38:58.863801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bd616-68e1-4abf-8e83-9f376610ce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:38:58.864459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bd616-68e1-4abf-8e83-9f376610ce23 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:38:58.864740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bd616-68e1-4abf-8e83-9f376610ce23 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:38:58.865015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bd616-68e1-4abf-8e83-9f376610ce23 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:38:58.866479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bd616-68e1-4abf-8e83-9f376610ce23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:38:58.867930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bd616-68e1-4abf-8e83-9f376610ce23 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:38:58.894855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 584/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:38:58 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:01.013175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9a0e-a135-41b1-8e19-4d1a7eafcc49 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.013750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9a0e-a135-41b1-8e19-4d1a7eafcc49 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.013750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9a0e-a135-41b1-8e19-4d1a7eafcc49 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.015133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 590/1174] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:01.020425 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910eac9-757d-4c6c-b44a-9d8045af3d38 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.020866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910eac9-757d-4c6c-b44a-9d8045af3d38 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.020984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910eac9-757d-4c6c-b44a-9d8045af3d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.040474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d910eac9-757d-4c6c-b44a-9d8045af3d38 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:01.041689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d910eac9-757d-4c6c-b44a-9d8045af3d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:01.113769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 585/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:39:01.139721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9a0e-a135-41b1-8e19-4d1a7eafcc49 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:01.207356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:01.257721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9a0e-a135-41b1-8e19-4d1a7eafcc49 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:01.291325 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69b860-0c33-4434-b8e6-c351efa7688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:01.292098 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69b860-0c33-4434-b8e6-c351efa7688a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.292379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69b860-0c33-4434-b8e6-c351efa7688a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.292657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69b860-0c33-4434-b8e6-c351efa7688a None admin] PATH_INFO: `/v3/domains/0dc715bfb3f44cf5882f7e8f339a053b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.293836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69b860-0c33-4434-b8e6-c351efa7688a None admin] RBAC: Authorizing `identity:get_domain(domain_id=0dc715bfb3f44cf5882f7e8f339a053b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:01.295293 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69b860-0c33-4434-b8e6-c351efa7688a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:01.296919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 591/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jun 23 10:39:01 2022] GET /identity/v3/domains/0dc715bfb3f44cf5882f7e8f339a053b => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:01.302851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910eac9-757d-4c6c-b44a-9d8045af3d38 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:01.350649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:01.407630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910eac9-757d-4c6c-b44a-9d8045af3d38 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:01.441510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ac5d7-9e48-4c11-9631-d4bff51ef5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:01.442168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac5d7-9e48-4c11-9631-d4bff51ef5a1 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:01.442482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac5d7-9e48-4c11-9631-d4bff51ef5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:01.442764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ac5d7-9e48-4c11-9631-d4bff51ef5a1 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:01.444123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac5d7-9e48-4c11-9631-d4bff51ef5a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:01.445569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ac5d7-9e48-4c11-9631-d4bff51ef5a1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:01.466451 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 586/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:39:01 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:39:03.604892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6320d-e121-4c47-8b2b-9dd91f7c0a73 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.605471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6320d-e121-4c47-8b2b-9dd91f7c0a73 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.605471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6320d-e121-4c47-8b2b-9dd91f7c0a73 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.606846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 592/1178] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:03.612278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1a57-7582-4c24-af8c-34ed4314dec2 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.612692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1a57-7582-4c24-af8c-34ed4314dec2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.612886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1a57-7582-4c24-af8c-34ed4314dec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.629866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b4be1a57-7582-4c24-af8c-34ed4314dec2 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:03.631612 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b4be1a57-7582-4c24-af8c-34ed4314dec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:03.699797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 587/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:39:03.724478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6320d-e121-4c47-8b2b-9dd91f7c0a73 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.839177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6320d-e121-4c47-8b2b-9dd91f7c0a73 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:03.864789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:03.876553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315c08-42a0-4b01-a7da-285a9a0c7090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:03.877342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315c08-42a0-4b01-a7da-285a9a0c7090 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:03.877628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315c08-42a0-4b01-a7da-285a9a0c7090 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:03.877908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51315c08-42a0-4b01-a7da-285a9a0c7090 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:03.890541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51315c08-42a0-4b01-a7da-285a9a0c7090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-51315c08-42a0-4b01-a7da-285a9a0c7090 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:03.898187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:03.899345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:39:03.900234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 593/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:03.905710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1a57-7582-4c24-af8c-34ed4314dec2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:03.936554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.008380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1a57-7582-4c24-af8c-34ed4314dec2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.042776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0327535-53ae-4bfb-87d1-070027b61e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.043451 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0327535-53ae-4bfb-87d1-070027b61e88 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.043735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0327535-53ae-4bfb-87d1-070027b61e88 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.044014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0327535-53ae-4bfb-87d1-070027b61e88 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.044767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0327535-53ae-4bfb-87d1-070027b61e88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:04.045077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0327535-53ae-4bfb-87d1-070027b61e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.046477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0327535-53ae-4bfb-87d1-070027b61e88 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.056215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 588/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.062263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315c08-42a0-4b01-a7da-285a9a0c7090 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.175597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51315c08-42a0-4b01-a7da-285a9a0c7090 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.212777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a63cd9-3922-4d9b-8a37-90ec7ba8e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.213642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a63cd9-3922-4d9b-8a37-90ec7ba8e3cd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.213917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a63cd9-3922-4d9b-8a37-90ec7ba8e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.214189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a63cd9-3922-4d9b-8a37-90ec7ba8e3cd None admin] PATH_INFO: `/v3/users/4737295c2e4d4672a25f37a592bf9380` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.228408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a63cd9-3922-4d9b-8a37-90ec7ba8e3cd None admin] RBAC: Authorizing `identity:get_user(user_id=4737295c2e4d4672a25f37a592bf9380)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.229854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a63cd9-3922-4d9b-8a37-90ec7ba8e3cd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.231600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 594/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/users/4737295c2e4d4672a25f37a592bf9380 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.237533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0327535-53ae-4bfb-87d1-070027b61e88 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.336526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.343821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0327535-53ae-4bfb-87d1-070027b61e88 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.382515 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2c737-858c-406c-9281-56713fa00eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.383157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2c737-858c-406c-9281-56713fa00eb7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.383435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2c737-858c-406c-9281-56713fa00eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.383716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2c737-858c-406c-9281-56713fa00eb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.454541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2c737-858c-406c-9281-56713fa00eb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.455904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2c737-858c-406c-9281-56713fa00eb7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.548888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.557351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 589/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:39:04.563455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a63cd9-3922-4d9b-8a37-90ec7ba8e3cd None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.607332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:04.663570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a63cd9-3922-4d9b-8a37-90ec7ba8e3cd None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.697351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f589-70ae-423a-82dc-b931bb4a9d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.698195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f589-70ae-423a-82dc-b931bb4a9d7b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.698511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f589-70ae-423a-82dc-b931bb4a9d7b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.699082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f589-70ae-423a-82dc-b931bb4a9d7b None admin] PATH_INFO: `/v3/projects/3047af7d0e9346d28f6f02f13fc74e9a` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.699977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f589-70ae-423a-82dc-b931bb4a9d7b None admin] RBAC: Authorizing `identity:get_project(project_id=3047af7d0e9346d28f6f02f13fc74e9a)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.701404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f589-70ae-423a-82dc-b931bb4a9d7b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.703129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 595/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/projects/3047af7d0e9346d28f6f02f13fc74e9a => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:04.710666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2c737-858c-406c-9281-56713fa00eb7 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:04.816506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2c737-858c-406c-9281-56713fa00eb7 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:04.853688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0db388-c111-418f-9255-274e439989f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:04.854365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0db388-c111-418f-9255-274e439989f9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:04.854663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0db388-c111-418f-9255-274e439989f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:04.854939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0db388-c111-418f-9255-274e439989f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:04.855766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0db388-c111-418f-9255-274e439989f9 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=3047af7d0e9346d28f6f02f13fc74e9a, user.id=4737295c2e4d4672a25f37a592bf9380) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:04.856072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0db388-c111-418f-9255-274e439989f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:04.857517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0db388-c111-418f-9255-274e439989f9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:04.863327 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 590/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:04 2022] GET /identity/v3/role_assignments?user.id=4737295c2e4d4672a25f37a592bf9380&scope.project.id=3047af7d0e9346d28f6f02f13fc74e9a&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:06.907502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49608b0d-f708-4416-bf65-68181448ceba None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:06.908066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49608b0d-f708-4416-bf65-68181448ceba None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:06.908066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49608b0d-f708-4416-bf65-68181448ceba None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:06.909398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 596/1186] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:06.915401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d697ccc-1ace-48e1-94a1-87b9a98870c4 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:06.915865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d697ccc-1ace-48e1-94a1-87b9a98870c4 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:06.915956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d697ccc-1ace-48e1-94a1-87b9a98870c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:06.932692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-5d697ccc-1ace-48e1-94a1-87b9a98870c4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:06.933881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5d697ccc-1ace-48e1-94a1-87b9a98870c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:06.988497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:07.002887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 591/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:39:07.026937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49608b0d-f708-4416-bf65-68181448ceba None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.132834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49608b0d-f708-4416-bf65-68181448ceba None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.145223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:07.171851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f547f35-700e-4511-85f8-89ab74ce7531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.172558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f547f35-700e-4511-85f8-89ab74ce7531 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.172841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f547f35-700e-4511-85f8-89ab74ce7531 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.173115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f547f35-700e-4511-85f8-89ab74ce7531 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.184493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f547f35-700e-4511-85f8-89ab74ce7531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-2f547f35-700e-4511-85f8-89ab74ce7531 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:07.192286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:07.194709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:39:07.195868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 597/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:07.200612 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d697ccc-1ace-48e1-94a1-87b9a98870c4 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.301535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d697ccc-1ace-48e1-94a1-87b9a98870c4 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.337566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3dbe2-7d70-4897-895f-a25f864b3c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.338225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3dbe2-7d70-4897-895f-a25f864b3c5a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.338538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3dbe2-7d70-4897-895f-a25f864b3c5a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.338818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3dbe2-7d70-4897-895f-a25f864b3c5a None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.339565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3dbe2-7d70-4897-895f-a25f864b3c5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:07.339871 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3dbe2-7d70-4897-895f-a25f864b3c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:07.341267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3dbe2-7d70-4897-895f-a25f864b3c5a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:07.349707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 592/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:07.355549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f547f35-700e-4511-85f8-89ab74ce7531 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.460908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f547f35-700e-4511-85f8-89ab74ce7531 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.495422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba77db7-9544-4293-b6bd-91127ede8c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.496364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba77db7-9544-4293-b6bd-91127ede8c2d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.496647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba77db7-9544-4293-b6bd-91127ede8c2d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.496922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba77db7-9544-4293-b6bd-91127ede8c2d None admin] PATH_INFO: `/v3/users/4737295c2e4d4672a25f37a592bf9380` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.498243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba77db7-9544-4293-b6bd-91127ede8c2d None admin] RBAC: Authorizing `identity:get_user(user_id=4737295c2e4d4672a25f37a592bf9380)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:07.499701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba77db7-9544-4293-b6bd-91127ede8c2d None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:07.501323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 598/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:07 2022] GET /identity/v3/users/4737295c2e4d4672a25f37a592bf9380 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:07.508374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3dbe2-7d70-4897-895f-a25f864b3c5a None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.561988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:07.614510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3dbe2-7d70-4897-895f-a25f864b3c5a None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.649187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fe314-e54c-4073-946e-5d11b95042da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.650067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fe314-e54c-4073-946e-5d11b95042da None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.650372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fe314-e54c-4073-946e-5d11b95042da None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.650650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fe314-e54c-4073-946e-5d11b95042da None admin] PATH_INFO: `/v3/projects/3047af7d0e9346d28f6f02f13fc74e9a` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.651835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fe314-e54c-4073-946e-5d11b95042da None admin] RBAC: Authorizing `identity:get_project(project_id=3047af7d0e9346d28f6f02f13fc74e9a)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:07.653263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fe314-e54c-4073-946e-5d11b95042da None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:07.654996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 593/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:07 2022] GET /identity/v3/projects/3047af7d0e9346d28f6f02f13fc74e9a => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:07.661061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba77db7-9544-4293-b6bd-91127ede8c2d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:07.702866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:07.763267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba77db7-9544-4293-b6bd-91127ede8c2d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:07.795925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6655fe-0ac8-42b2-93b4-57d24dd4f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:07.796808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6655fe-0ac8-42b2-93b4-57d24dd4f663 None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:07.797089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6655fe-0ac8-42b2-93b4-57d24dd4f663 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:07.797364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6655fe-0ac8-42b2-93b4-57d24dd4f663 None admin] PATH_INFO: `/v3/projects/3047af7d0e9346d28f6f02f13fc74e9a/users/4737295c2e4d4672a25f37a592bf9380/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:07.799367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6655fe-0ac8-42b2-93b4-57d24dd4f663 None admin] RBAC: Authorizing `identity:create_grant(project_id=3047af7d0e9346d28f6f02f13fc74e9a, user_id=4737295c2e4d4672a25f37a592bf9380, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:07.800793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6655fe-0ac8-42b2-93b4-57d24dd4f663 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:07.816339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 599/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:39:07 2022] PUT /identity/v3/projects/3047af7d0e9346d28f6f02f13fc74e9a/users/4737295c2e4d4672a25f37a592bf9380/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:39:09.864795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea528461-6f64-4920-a724-bb0fdc1a5143 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:09.866028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea528461-6f64-4920-a724-bb0fdc1a5143 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:09.866028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea528461-6f64-4920-a724-bb0fdc1a5143 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:09.867396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 594/1193] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:39:09.872969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d470d2-c201-45c5-b964-2f22738b7864 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:09.873439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d470d2-c201-45c5-b964-2f22738b7864 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:09.873553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d470d2-c201-45c5-b964-2f22738b7864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:09.892522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-74d470d2-c201-45c5-b964-2f22738b7864 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:39:09.893735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-74d470d2-c201-45c5-b964-2f22738b7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:39:09.962400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 600/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:39:09.986282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea528461-6f64-4920-a724-bb0fdc1a5143 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:10.091642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea528461-6f64-4920-a724-bb0fdc1a5143 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:10.110165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:10.128853 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac615f0-562a-462a-820f-0d258aebe0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:10.129571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac615f0-562a-462a-820f-0d258aebe0c0 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.129860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac615f0-562a-462a-820f-0d258aebe0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.130141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac615f0-562a-462a-820f-0d258aebe0c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.141805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac615f0-562a-462a-820f-0d258aebe0c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-6ac615f0-562a-462a-820f-0d258aebe0c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:39:10.150277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:39:10.151459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:39:10.152511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 595/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:39:10.157849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d470d2-c201-45c5-b964-2f22738b7864 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:10.186082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:10.262565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d470d2-c201-45c5-b964-2f22738b7864 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:10.296773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cc30e-b480-47a8-a2b1-62626ff01f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:10.297444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cc30e-b480-47a8-a2b1-62626ff01f81 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.297733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cc30e-b480-47a8-a2b1-62626ff01f81 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.298013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cc30e-b480-47a8-a2b1-62626ff01f81 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.298801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cc30e-b480-47a8-a2b1-62626ff01f81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:10.299113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cc30e-b480-47a8-a2b1-62626ff01f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:10.300498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cc30e-b480-47a8-a2b1-62626ff01f81 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:10.309068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 601/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:10.315028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac615f0-562a-462a-820f-0d258aebe0c0 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:10.416654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac615f0-562a-462a-820f-0d258aebe0c0 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:10.452393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351aa4b-929d-4f00-a0c9-1e953f50e2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:10.453264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351aa4b-929d-4f00-a0c9-1e953f50e2d1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.453620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351aa4b-929d-4f00-a0c9-1e953f50e2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.453932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351aa4b-929d-4f00-a0c9-1e953f50e2d1 None admin] PATH_INFO: `/v3/users/4737295c2e4d4672a25f37a592bf9380` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.455157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351aa4b-929d-4f00-a0c9-1e953f50e2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=4737295c2e4d4672a25f37a592bf9380)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:10.456593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351aa4b-929d-4f00-a0c9-1e953f50e2d1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:10.458220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 596/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jun 23 10:39:10 2022] GET /identity/v3/users/4737295c2e4d4672a25f37a592bf9380 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:39:10.464912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cc30e-b480-47a8-a2b1-62626ff01f81 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:10.560865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:10.572040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cc30e-b480-47a8-a2b1-62626ff01f81 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:10.609454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260341d1-763d-4332-b5b6-5239c60f9b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:10.610097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260341d1-763d-4332-b5b6-5239c60f9b67 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.610405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260341d1-763d-4332-b5b6-5239c60f9b67 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.610685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260341d1-763d-4332-b5b6-5239c60f9b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.678576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260341d1-763d-4332-b5b6-5239c60f9b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:10.679939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260341d1-763d-4332-b5b6-5239c60f9b67 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:10.769456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:10.780432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 602/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:39:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:39:10.786478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351aa4b-929d-4f00-a0c9-1e953f50e2d1 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:10.839288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:10.893397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351aa4b-929d-4f00-a0c9-1e953f50e2d1 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:10.928865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08631b4d-ea91-4e61-886d-e80e26fa56c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:10.929646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08631b4d-ea91-4e61-886d-e80e26fa56c4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:10.929933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08631b4d-ea91-4e61-886d-e80e26fa56c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:10.930213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08631b4d-ea91-4e61-886d-e80e26fa56c4 None admin] PATH_INFO: `/v3/projects/3047af7d0e9346d28f6f02f13fc74e9a` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:10.931439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08631b4d-ea91-4e61-886d-e80e26fa56c4 None admin] RBAC: Authorizing `identity:get_project(project_id=3047af7d0e9346d28f6f02f13fc74e9a)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:10.932887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08631b4d-ea91-4e61-886d-e80e26fa56c4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:10.934636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 597/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jun 23 10:39:10 2022] GET /identity/v3/projects/3047af7d0e9346d28f6f02f13fc74e9a => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:10.940783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260341d1-763d-4332-b5b6-5239c60f9b67 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:39:11.042898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260341d1-763d-4332-b5b6-5239c60f9b67 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:39:11.077948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2b18d-753b-4b74-9776-f3252874b521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:39:11.078620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b18d-753b-4b74-9776-f3252874b521 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:39:11.078899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b18d-753b-4b74-9776-f3252874b521 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:39:11.079176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b18d-753b-4b74-9776-f3252874b521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:39:11.080009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2b18d-753b-4b74-9776-f3252874b521 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=3047af7d0e9346d28f6f02f13fc74e9a, user.id=4737295c2e4d4672a25f37a592bf9380) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:39:11.080464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2b18d-753b-4b74-9776-f3252874b521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:39:11.081895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2b18d-753b-4b74-9776-f3252874b521 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:39:11.088059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 603/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:39:10 2022] GET /identity/v3/role_assignments?user.id=4737295c2e4d4672a25f37a592bf9380&scope.project.id=3047af7d0e9346d28f6f02f13fc74e9a&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:39:20.923815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=43 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:39:21.086085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=73 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:08.531791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c70a-ff4d-4512-903e-1f7b07912875 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.532413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c70a-ff4d-4512-903e-1f7b07912875 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.532413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371c70a-ff4d-4512-903e-1f7b07912875 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.534133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 598/1201] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:08.543108 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8a906-0c00-4ec1-a7b4-9578c7856715 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.543540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8a906-0c00-4ec1-a7b4-9578c7856715 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.543711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8a906-0c00-4ec1-a7b4-9578c7856715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.569591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d4e8a906-0c00-4ec1-a7b4-9578c7856715 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:08.571857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d4e8a906-0c00-4ec1-a7b4-9578c7856715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:08.674407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 604/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:40:08.693444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c70a-ff4d-4512-903e-1f7b07912875 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:08.856640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371c70a-ff4d-4512-903e-1f7b07912875 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:08.916374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef499b2-da30-46f5-b63b-0f820775cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:08.917300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef499b2-da30-46f5-b63b-0f820775cc74 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:08.917585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef499b2-da30-46f5-b63b-0f820775cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:08.917882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef499b2-da30-46f5-b63b-0f820775cc74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:08.932704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef499b2-da30-46f5-b63b-0f820775cc74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:08.934272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef499b2-da30-46f5-b63b-0f820775cc74 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-7ef499b2-da30-46f5-b63b-0f820775cc74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:08.956797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:08.958117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:08.969462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:08.969462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:08.969462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:08.969462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:08.969462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 599/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:08.969924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8a906-0c00-4ec1-a7b4-9578c7856715 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.104393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8a906-0c00-4ec1-a7b4-9578c7856715 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.146829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.158502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228165d-015c-4acd-80ba-6f18d7e40ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.159476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228165d-015c-4acd-80ba-6f18d7e40ea9 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.159790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228165d-015c-4acd-80ba-6f18d7e40ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.160389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228165d-015c-4acd-80ba-6f18d7e40ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.161358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228165d-015c-4acd-80ba-6f18d7e40ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:09.161718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228165d-015c-4acd-80ba-6f18d7e40ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.163276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228165d-015c-4acd-80ba-6f18d7e40ea9 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.178498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 605/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:09.187514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef499b2-da30-46f5-b63b-0f820775cc74 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:09.278741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:09.358007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef499b2-da30-46f5-b63b-0f820775cc74 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:09.412405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6f66f-d205-4807-ad7d-6db52902b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:09.414360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f66f-d205-4807-ad7d-6db52902b8a4 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:09.414360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f66f-d205-4807-ad7d-6db52902b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:09.414360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f66f-d205-4807-ad7d-6db52902b8a4 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:09.414944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6f66f-d205-4807-ad7d-6db52902b8a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:09.417304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6f66f-d205-4807-ad7d-6db52902b8a4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:09.462351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 600/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jun 23 10:40:09 2022] POST /identity/v3/users => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:11.800987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f57a9-de6e-4939-b2f1-6405db7bfc8e None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.801773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f57a9-de6e-4939-b2f1-6405db7bfc8e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.801773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f57a9-de6e-4939-b2f1-6405db7bfc8e None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.806370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 606/1206] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:11.811396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac82cd-822c-4cc0-b2d8-f395ab473de4 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:11.811876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac82cd-822c-4cc0-b2d8-f395ab473de4 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:11.812291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac82cd-822c-4cc0-b2d8-f395ab473de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:11.837760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f6ac82cd-822c-4cc0-b2d8-f395ab473de4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:11.839397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f6ac82cd-822c-4cc0-b2d8-f395ab473de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:11.930377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 601/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:11.952735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f57a9-de6e-4939-b2f1-6405db7bfc8e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.112716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f57a9-de6e-4939-b2f1-6405db7bfc8e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.161507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eab0b-729d-4ed3-a129-af9918069257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.162400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eab0b-729d-4ed3-a129-af9918069257 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.162760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eab0b-729d-4ed3-a129-af9918069257 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.163160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08eab0b-729d-4ed3-a129-af9918069257 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.178927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08eab0b-729d-4ed3-a129-af9918069257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-a08eab0b-729d-4ed3-a129-af9918069257 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:12.188706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:12.196125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:12.197202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 607/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:40:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:12.199627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac82cd-822c-4cc0-b2d8-f395ab473de4 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.244288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:12.326828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac82cd-822c-4cc0-b2d8-f395ab473de4 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.374078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d149e3-1efe-4edb-ba9f-965a9b246957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.375516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d149e3-1efe-4edb-ba9f-965a9b246957 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.375954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d149e3-1efe-4edb-ba9f-965a9b246957 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.376386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d149e3-1efe-4edb-ba9f-965a9b246957 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.377657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d149e3-1efe-4edb-ba9f-965a9b246957 None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:12.378175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d149e3-1efe-4edb-ba9f-965a9b246957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:12.380598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d149e3-1efe-4edb-ba9f-965a9b246957 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:12.393878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 602/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:12.403357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eab0b-729d-4ed3-a129-af9918069257 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.471646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:12.549819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08eab0b-729d-4ed3-a129-af9918069257 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.595138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c5a9a-faa0-4b90-91a9-d1f5cb6c64a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.596451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c5a9a-faa0-4b90-91a9-d1f5cb6c64a1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.596875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c5a9a-faa0-4b90-91a9-d1f5cb6c64a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.597237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c5a9a-faa0-4b90-91a9-d1f5cb6c64a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.610301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c5a9a-faa0-4b90-91a9-d1f5cb6c64a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:12.611908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c5a9a-faa0-4b90-91a9-d1f5cb6c64a1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-ce0c5a9a-faa0-4b90-91a9-d1f5cb6c64a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:12.637769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:12.638828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:12.646604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:12.646604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:12.646604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:12.646604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:12.646604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 608/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:12.646955 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d149e3-1efe-4edb-ba9f-965a9b246957 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:12.821864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d149e3-1efe-4edb-ba9f-965a9b246957 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:12.823721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:12.875808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979de0a-271f-4f3c-8b01-51ed9fdb429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:12.876486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979de0a-271f-4f3c-8b01-51ed9fdb429e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:12.876822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979de0a-271f-4f3c-8b01-51ed9fdb429e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:12.877108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979de0a-271f-4f3c-8b01-51ed9fdb429e None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:12.877865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979de0a-271f-4f3c-8b01-51ed9fdb429e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:12.878171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979de0a-271f-4f3c-8b01-51ed9fdb429e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:12.882797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979de0a-271f-4f3c-8b01-51ed9fdb429e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:12.908903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 603/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:12.910126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c5a9a-faa0-4b90-91a9-d1f5cb6c64a1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:13.062197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c5a9a-faa0-4b90-91a9-d1f5cb6c64a1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.065640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:13.115208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288c1b2-6295-4738-b5ca-8b69898040e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.116032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288c1b2-6295-4738-b5ca-8b69898040e0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.116321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288c1b2-6295-4738-b5ca-8b69898040e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.116676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288c1b2-6295-4738-b5ca-8b69898040e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.127943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288c1b2-6295-4738-b5ca-8b69898040e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.129359 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288c1b2-6295-4738-b5ca-8b69898040e0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-4288c1b2-6295-4738-b5ca-8b69898040e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:13.149860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:13.152343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:13.154545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 609/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:13.160072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979de0a-271f-4f3c-8b01-51ed9fdb429e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:13.312697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979de0a-271f-4f3c-8b01-51ed9fdb429e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.357032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e011f-2f79-40d9-90ab-3c293c0082b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.357713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e011f-2f79-40d9-90ab-3c293c0082b7 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.357997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e011f-2f79-40d9-90ab-3c293c0082b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.358277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e011f-2f79-40d9-90ab-3c293c0082b7 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.359165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e011f-2f79-40d9-90ab-3c293c0082b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:13.359479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e011f-2f79-40d9-90ab-3c293c0082b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.360948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e011f-2f79-40d9-90ab-3c293c0082b7 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.381082 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 604/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 23 10:40:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:13.389613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288c1b2-6295-4738-b5ca-8b69898040e0 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:13.510185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288c1b2-6295-4738-b5ca-8b69898040e0 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.559470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dcb49-d252-4598-b75c-667cfc85df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.560109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dcb49-d252-4598-b75c-667cfc85df0f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.560390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dcb49-d252-4598-b75c-667cfc85df0f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.560664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89dcb49-d252-4598-b75c-667cfc85df0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:13.597058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:13.647402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dcb49-d252-4598-b75c-667cfc85df0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:13.649341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89dcb49-d252-4598-b75c-667cfc85df0f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:13.783371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 610/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:13.795640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e011f-2f79-40d9-90ab-3c293c0082b7 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:13.822900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:13.933791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e011f-2f79-40d9-90ab-3c293c0082b7 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:13.979837 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b91c59-6113-4fbe-a882-96d7b307a606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:13.980747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b91c59-6113-4fbe-a882-96d7b307a606 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:13.981072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b91c59-6113-4fbe-a882-96d7b307a606 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:13.981355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b91c59-6113-4fbe-a882-96d7b307a606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.001125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b91c59-6113-4fbe-a882-96d7b307a606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:14.002799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b91c59-6113-4fbe-a882-96d7b307a606 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-75b91c59-6113-4fbe-a882-96d7b307a606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:14.030444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:14.031479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:14.032396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:14.032396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:14.032396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:14.032396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:14.033586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 605/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:14.040643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dcb49-d252-4598-b75c-667cfc85df0f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:14.120386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:14.180962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89dcb49-d252-4598-b75c-667cfc85df0f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:14.233941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90545866-210d-499e-a4cd-1cdfe21fb47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:14.234803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90545866-210d-499e-a4cd-1cdfe21fb47f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.235220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90545866-210d-499e-a4cd-1cdfe21fb47f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.235630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90545866-210d-499e-a4cd-1cdfe21fb47f None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.236501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90545866-210d-499e-a4cd-1cdfe21fb47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:14.236885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90545866-210d-499e-a4cd-1cdfe21fb47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:14.238491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90545866-210d-499e-a4cd-1cdfe21fb47f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:14.253094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 611/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:14.260077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b91c59-6113-4fbe-a882-96d7b307a606 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:14.360848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:14.403619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b91c59-6113-4fbe-a882-96d7b307a606 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:14.453578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33355db0-2a56-4ef3-80a2-93cf3abf090d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:14.454155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33355db0-2a56-4ef3-80a2-93cf3abf090d None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.454479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33355db0-2a56-4ef3-80a2-93cf3abf090d None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.454857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33355db0-2a56-4ef3-80a2-93cf3abf090d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.464298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33355db0-2a56-4ef3-80a2-93cf3abf090d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:14.465933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33355db0-2a56-4ef3-80a2-93cf3abf090d None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-33355db0-2a56-4ef3-80a2-93cf3abf090d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:14.482275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:14.484190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:14.486116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:14.486116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:14.486116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:14.486116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:14.486116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:14.486116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:14.486116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:14.486116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:14.486116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 606/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:14.493835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90545866-210d-499e-a4cd-1cdfe21fb47f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:14.631794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90545866-210d-499e-a4cd-1cdfe21fb47f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:14.660363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:14.673668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a58ce3-3383-4bc9-8b62-8d9bf9ae4648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:14.674354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a58ce3-3383-4bc9-8b62-8d9bf9ae4648 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.674750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a58ce3-3383-4bc9-8b62-8d9bf9ae4648 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.675033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a58ce3-3383-4bc9-8b62-8d9bf9ae4648 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.676036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a58ce3-3383-4bc9-8b62-8d9bf9ae4648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:14.676495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a58ce3-3383-4bc9-8b62-8d9bf9ae4648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:14.678199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a58ce3-3383-4bc9-8b62-8d9bf9ae4648 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:14.704145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 612/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:14.704350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33355db0-2a56-4ef3-80a2-93cf3abf090d None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:14.837090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33355db0-2a56-4ef3-80a2-93cf3abf090d None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:14.888469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:14.896852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f836ff-f9a1-4c7b-ab32-4056fbba6cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:14.897515 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f836ff-f9a1-4c7b-ab32-4056fbba6cb4 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:14.898896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f836ff-f9a1-4c7b-ab32-4056fbba6cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:14.899399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f836ff-f9a1-4c7b-ab32-4056fbba6cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:14.900265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f836ff-f9a1-4c7b-ab32-4056fbba6cb4 None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=64ce422f60d64b368df8be61e1065282) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:14.900633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f836ff-f9a1-4c7b-ab32-4056fbba6cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:14.902461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f836ff-f9a1-4c7b-ab32-4056fbba6cb4 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:14.912704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 607/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:14 2022] GET /identity/v3/role_assignments?user.id=64ce422f60d64b368df8be61e1065282&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:17.061413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32bb4-cd20-43f1-99aa-251e86b716a0 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.061989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32bb4-cd20-43f1-99aa-251e86b716a0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.061989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa32bb4-cd20-43f1-99aa-251e86b716a0 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.063365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 613/1220] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:17.070377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a4246-c74d-4807-8e5b-6ef56b0b0fff None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.070894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a4246-c74d-4807-8e5b-6ef56b0b0fff None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.070995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a4246-c74d-4807-8e5b-6ef56b0b0fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.093548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b61a4246-c74d-4807-8e5b-6ef56b0b0fff None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:17.094934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b61a4246-c74d-4807-8e5b-6ef56b0b0fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:17.185746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 608/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:17.209911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa32bb4-cd20-43f1-99aa-251e86b716a0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.333644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa32bb4-cd20-43f1-99aa-251e86b716a0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.389188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ebe30-3b7a-40cb-a870-ac9b22de6fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.390528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ebe30-3b7a-40cb-a870-ac9b22de6fe8 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.390906 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ebe30-3b7a-40cb-a870-ac9b22de6fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.391281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ebe30-3b7a-40cb-a870-ac9b22de6fe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.405591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ebe30-3b7a-40cb-a870-ac9b22de6fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-198ebe30-3b7a-40cb-a870-ac9b22de6fe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:17.414560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:17.415788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:17.416841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 614/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:17.422423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a4246-c74d-4807-8e5b-6ef56b0b0fff None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.549935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a4246-c74d-4807-8e5b-6ef56b0b0fff None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.579674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.593716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07703dbd-0f34-4481-a313-a92650dd7e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.594372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07703dbd-0f34-4481-a313-a92650dd7e63 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.594653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07703dbd-0f34-4481-a313-a92650dd7e63 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.594933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07703dbd-0f34-4481-a313-a92650dd7e63 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.595703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07703dbd-0f34-4481-a313-a92650dd7e63 None admin] RBAC: Adding query filter params (name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:17.596016 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07703dbd-0f34-4481-a313-a92650dd7e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.597418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07703dbd-0f34-4481-a313-a92650dd7e63 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.606987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 609/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:17.612801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ebe30-3b7a-40cb-a870-ac9b22de6fe8 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.666585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:17.737049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ebe30-3b7a-40cb-a870-ac9b22de6fe8 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.775625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da7fda-2a36-4458-8c58-aaa11353b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.776465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da7fda-2a36-4458-8c58-aaa11353b767 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.776751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da7fda-2a36-4458-8c58-aaa11353b767 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.777109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da7fda-2a36-4458-8c58-aaa11353b767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.790418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da7fda-2a36-4458-8c58-aaa11353b767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.791957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da7fda-2a36-4458-8c58-aaa11353b767 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-35da7fda-2a36-4458-8c58-aaa11353b767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:17.813378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:17.814440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:17.815386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:17.815386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:17.815386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:17.815386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:17.815386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 615/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:17.822336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07703dbd-0f34-4481-a313-a92650dd7e63 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:17.957144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07703dbd-0f34-4481-a313-a92650dd7e63 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:17.995266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60de3fe-7da6-4c7f-afd8-b0aeba6299d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:17.995712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60de3fe-7da6-4c7f-afd8-b0aeba6299d9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:17.996030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60de3fe-7da6-4c7f-afd8-b0aeba6299d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:17.996284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60de3fe-7da6-4c7f-afd8-b0aeba6299d9 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:17.997018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60de3fe-7da6-4c7f-afd8-b0aeba6299d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:17.997337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60de3fe-7da6-4c7f-afd8-b0aeba6299d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:17.998785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60de3fe-7da6-4c7f-afd8-b0aeba6299d9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.013309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 610/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:18.019128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da7fda-2a36-4458-8c58-aaa11353b767 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.133227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.142203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da7fda-2a36-4458-8c58-aaa11353b767 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.183731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e2fa-4394-4416-9d44-d4b7ddcd4440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.184530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e2fa-4394-4416-9d44-d4b7ddcd4440 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.184811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e2fa-4394-4416-9d44-d4b7ddcd4440 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.185087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412e2fa-4394-4416-9d44-d4b7ddcd4440 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.193647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412e2fa-4394-4416-9d44-d4b7ddcd4440 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.195282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412e2fa-4394-4416-9d44-d4b7ddcd4440 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-8412e2fa-4394-4416-9d44-d4b7ddcd4440 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:18.211125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:18.212391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:18.213544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 616/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:18.218344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60de3fe-7da6-4c7f-afd8-b0aeba6299d9 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.268407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.338546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60de3fe-7da6-4c7f-afd8-b0aeba6299d9 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.388267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bf083-57f5-4c3d-9939-13b3af5c6785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.389265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bf083-57f5-4c3d-9939-13b3af5c6785 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.389572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bf083-57f5-4c3d-9939-13b3af5c6785 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.389902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bf083-57f5-4c3d-9939-13b3af5c6785 None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.390939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bf083-57f5-4c3d-9939-13b3af5c6785 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:18.391368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bf083-57f5-4c3d-9939-13b3af5c6785 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.393081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bf083-57f5-4c3d-9939-13b3af5c6785 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.412694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 611/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:18.418363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e2fa-4394-4416-9d44-d4b7ddcd4440 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.530895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412e2fa-4394-4416-9d44-d4b7ddcd4440 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.571713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214480ba-3674-4e2e-ac1e-051f25622cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.572513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214480ba-3674-4e2e-ac1e-051f25622cbd None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.572880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214480ba-3674-4e2e-ac1e-051f25622cbd None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.573109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214480ba-3674-4e2e-ac1e-051f25622cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.586723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214480ba-3674-4e2e-ac1e-051f25622cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.588244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214480ba-3674-4e2e-ac1e-051f25622cbd None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-214480ba-3674-4e2e-ac1e-051f25622cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:18.607376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:18.608904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:18.610389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:18.610389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:18.610389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:18.610389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:18.610389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 617/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:18.616000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bf083-57f5-4c3d-9939-13b3af5c6785 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.736958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bf083-57f5-4c3d-9939-13b3af5c6785 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.739456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.781402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3bb20-b010-4a8f-aca1-6e72cc375374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.781881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3bb20-b010-4a8f-aca1-6e72cc375374 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.782165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3bb20-b010-4a8f-aca1-6e72cc375374 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.782575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3bb20-b010-4a8f-aca1-6e72cc375374 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.783272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3bb20-b010-4a8f-aca1-6e72cc375374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:18.783594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3bb20-b010-4a8f-aca1-6e72cc375374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.785015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3bb20-b010-4a8f-aca1-6e72cc375374 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:18.799516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 612/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:18.806800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214480ba-3674-4e2e-ac1e-051f25622cbd None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:18.818142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:18.940380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214480ba-3674-4e2e-ac1e-051f25622cbd None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:18.984166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d6f7-ad0a-44d7-bc52-25175ceac45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:18.985361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d6f7-ad0a-44d7-bc52-25175ceac45c None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:18.985861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d6f7-ad0a-44d7-bc52-25175ceac45c None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:18.986400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d6f7-ad0a-44d7-bc52-25175ceac45c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:18.999283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d6f7-ad0a-44d7-bc52-25175ceac45c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:18.999283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d6f7-ad0a-44d7-bc52-25175ceac45c None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-6cb7d6f7-ad0a-44d7-bc52-25175ceac45c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:19.012012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:19.013048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:19.014120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:19.014120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:19.014120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:19.014120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:19.014120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:19.014120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:19.014120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:19.014120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:19.014120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 618/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:19.019528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3bb20-b010-4a8f-aca1-6e72cc375374 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:19.163740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3bb20-b010-4a8f-aca1-6e72cc375374 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:19.216259 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8f3f-74db-43aa-91b6-3504c57df02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:19.216906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8f3f-74db-43aa-91b6-3504c57df02e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:19.217201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8f3f-74db-43aa-91b6-3504c57df02e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:19.217561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8f3f-74db-43aa-91b6-3504c57df02e None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:19.218555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8f3f-74db-43aa-91b6-3504c57df02e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:19.219101 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8f3f-74db-43aa-91b6-3504c57df02e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:19.220722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8f3f-74db-43aa-91b6-3504c57df02e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:19.238651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 613/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:19.245412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d6f7-ad0a-44d7-bc52-25175ceac45c None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:19.332033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:19.374435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d6f7-ad0a-44d7-bc52-25175ceac45c None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:19.416294 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d09dd9-582a-4566-bf65-477f9b6501a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:19.417228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d09dd9-582a-4566-bf65-477f9b6501a1 None admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:19.417530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d09dd9-582a-4566-bf65-477f9b6501a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:19.417870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d09dd9-582a-4566-bf65-477f9b6501a1 None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/64ce422f60d64b368df8be61e1065282/roles/758fd66475334e07a52a5472784207a7` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:19.436854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d09dd9-582a-4566-bf65-477f9b6501a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=64ce422f60d64b368df8be61e1065282, role_id=758fd66475334e07a52a5472784207a7)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:19.438424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d09dd9-582a-4566-bf65-477f9b6501a1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:19.454888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 619/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:40:19 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/64ce422f60d64b368df8be61e1065282/roles/758fd66475334e07a52a5472784207a7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:40:21.738012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212d67-0a82-4491-a21e-0f73ab4f1f4c None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.738012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212d67-0a82-4491-a21e-0f73ab4f1f4c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.738012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88212d67-0a82-4491-a21e-0f73ab4f1f4c None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.738012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 614/1233] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:21.744886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e14ce-b744-48f7-bbda-7a637e1efaa7 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:21.745386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e14ce-b744-48f7-bbda-7a637e1efaa7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:21.745482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e14ce-b744-48f7-bbda-7a637e1efaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:21.763456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-6f2e14ce-b744-48f7-bbda-7a637e1efaa7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:21.764770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6f2e14ce-b744-48f7-bbda-7a637e1efaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:21.846890 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 620/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:21.874232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212d67-0a82-4491-a21e-0f73ab4f1f4c None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:21.914067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.015221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88212d67-0a82-4491-a21e-0f73ab4f1f4c None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.060970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5850b-fb93-4eb6-821a-7ea524ebd7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.061835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5850b-fb93-4eb6-821a-7ea524ebd7ad None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.062172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5850b-fb93-4eb6-821a-7ea524ebd7ad None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.062466 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5850b-fb93-4eb6-821a-7ea524ebd7ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.075238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5850b-fb93-4eb6-821a-7ea524ebd7ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-73f5850b-fb93-4eb6-821a-7ea524ebd7ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:22.082989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:22.084070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:22.084938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 615/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jun 23 10:40:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:22.090460 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e14ce-b744-48f7-bbda-7a637e1efaa7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.146800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.222033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e14ce-b744-48f7-bbda-7a637e1efaa7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.259488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cd84b-f57f-4775-aef8-36a0df4027ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.260228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cd84b-f57f-4775-aef8-36a0df4027ee None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.260615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cd84b-f57f-4775-aef8-36a0df4027ee None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.260940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cd84b-f57f-4775-aef8-36a0df4027ee None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.261772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cd84b-f57f-4775-aef8-36a0df4027ee None admin] RBAC: Adding query filter params (name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:22.262080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cd84b-f57f-4775-aef8-36a0df4027ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.263680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cd84b-f57f-4775-aef8-36a0df4027ee None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.274698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 621/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:22.281912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5850b-fb93-4eb6-821a-7ea524ebd7ad None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.385723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.404626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5850b-fb93-4eb6-821a-7ea524ebd7ad None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.443003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee1fe1-95d3-4b4a-b678-8450218402d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.443923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee1fe1-95d3-4b4a-b678-8450218402d5 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.444205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee1fe1-95d3-4b4a-b678-8450218402d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.445038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee1fe1-95d3-4b4a-b678-8450218402d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.456440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee1fe1-95d3-4b4a-b678-8450218402d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.457985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee1fe1-95d3-4b4a-b678-8450218402d5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-6bee1fe1-95d3-4b4a-b678-8450218402d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:22.480479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:22.481699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:22.482751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:22.482751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:22.482751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:22.482751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:22.482751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 616/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:22.487682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cd84b-f57f-4775-aef8-36a0df4027ee None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.620523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cd84b-f57f-4775-aef8-36a0df4027ee None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.630952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.667508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94466ca7-ca57-427f-b896-1c7dd5afc04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.668417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94466ca7-ca57-427f-b896-1c7dd5afc04f None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.668707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94466ca7-ca57-427f-b896-1c7dd5afc04f None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.668990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94466ca7-ca57-427f-b896-1c7dd5afc04f None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.669799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94466ca7-ca57-427f-b896-1c7dd5afc04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:22.670111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94466ca7-ca57-427f-b896-1c7dd5afc04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.671669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94466ca7-ca57-427f-b896-1c7dd5afc04f None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.686193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 622/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:22.692997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee1fe1-95d3-4b4a-b678-8450218402d5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:22.809217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee1fe1-95d3-4b4a-b678-8450218402d5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:22.853740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cd7f3-0f98-46e0-bec2-b63231635f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:22.854666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cd7f3-0f98-46e0-bec2-b63231635f05 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:22.855014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cd7f3-0f98-46e0-bec2-b63231635f05 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:22.855336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cd7f3-0f98-46e0-bec2-b63231635f05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:22.859040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:22.866009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cd7f3-0f98-46e0-bec2-b63231635f05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:22.868236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cd7f3-0f98-46e0-bec2-b63231635f05 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-f87cd7f3-0f98-46e0-bec2-b63231635f05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:22.885922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:22.887208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:22.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 617/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:22.894231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94466ca7-ca57-427f-b896-1c7dd5afc04f None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.024394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94466ca7-ca57-427f-b896-1c7dd5afc04f None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:23.064862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682552-0558-45e3-9a1f-32acb731f4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:23.065827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682552-0558-45e3-9a1f-32acb731f4a1 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.066117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682552-0558-45e3-9a1f-32acb731f4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.066432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be682552-0558-45e3-9a1f-32acb731f4a1 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.067554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be682552-0558-45e3-9a1f-32acb731f4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:23.067867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be682552-0558-45e3-9a1f-32acb731f4a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:23.069315 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be682552-0558-45e3-9a1f-32acb731f4a1 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:23.090231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 623/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 23 10:40:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:23.096205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cd7f3-0f98-46e0-bec2-b63231635f05 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.226463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cd7f3-0f98-46e0-bec2-b63231635f05 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:23.269661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ef875-cd58-4747-9aa5-982d03fa41db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:23.270373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef875-cd58-4747-9aa5-982d03fa41db None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.270768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef875-cd58-4747-9aa5-982d03fa41db None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.271855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ef875-cd58-4747-9aa5-982d03fa41db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.354490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:23.364236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ef875-cd58-4747-9aa5-982d03fa41db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:23.365827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ef875-cd58-4747-9aa5-982d03fa41db None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:23.483717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 618/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:23.489584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682552-0558-45e3-9a1f-32acb731f4a1 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.521179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:23.622948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be682552-0558-45e3-9a1f-32acb731f4a1 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:23.659801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173fc72-5a3b-413f-8cca-657170455ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:23.661302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173fc72-5a3b-413f-8cca-657170455ac4 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.661590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173fc72-5a3b-413f-8cca-657170455ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.661875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173fc72-5a3b-413f-8cca-657170455ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.673925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173fc72-5a3b-413f-8cca-657170455ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:23.675417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173fc72-5a3b-413f-8cca-657170455ac4 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-e173fc72-5a3b-413f-8cca-657170455ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:23.694983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:23.696725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:23.697954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:23.697954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:23.697954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:23.697954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:23.697954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 624/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:23.702279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ef875-cd58-4747-9aa5-982d03fa41db None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.811618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:23.818983 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ef875-cd58-4747-9aa5-982d03fa41db None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:23.863464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd35ec-bda2-419b-abaa-c54b23809bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:23.864162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd35ec-bda2-419b-abaa-c54b23809bd1 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:23.864518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd35ec-bda2-419b-abaa-c54b23809bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:23.864726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd35ec-bda2-419b-abaa-c54b23809bd1 None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:23.865488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd35ec-bda2-419b-abaa-c54b23809bd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:23.865862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd35ec-bda2-419b-abaa-c54b23809bd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:23.867577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd35ec-bda2-419b-abaa-c54b23809bd1 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:23.884312 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 619/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:23.890857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173fc72-5a3b-413f-8cca-657170455ac4 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:23.991006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:24.016125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173fc72-5a3b-413f-8cca-657170455ac4 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:24.053586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e0256-bc2c-4943-9bc0-e12e08955b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:24.054778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e0256-bc2c-4943-9bc0-e12e08955b4b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:24.055200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e0256-bc2c-4943-9bc0-e12e08955b4b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:24.055606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e0256-bc2c-4943-9bc0-e12e08955b4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:24.064091 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e0256-bc2c-4943-9bc0-e12e08955b4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:24.065797 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e0256-bc2c-4943-9bc0-e12e08955b4b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-bc3e0256-bc2c-4943-9bc0-e12e08955b4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:24.083612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:24.084839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:24.091447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:24.091447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:24.091447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:24.091447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:24.091447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:24.091447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:24.091447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:24.091447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:24.091447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 625/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:24.092175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd35ec-bda2-419b-abaa-c54b23809bd1 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:24.215742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd35ec-bda2-419b-abaa-c54b23809bd1 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:24.254349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547ce82-52f4-4ffd-8dda-80d7f6905ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:24.255235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547ce82-52f4-4ffd-8dda-80d7f6905ad9 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:24.255517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547ce82-52f4-4ffd-8dda-80d7f6905ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:24.255829 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547ce82-52f4-4ffd-8dda-80d7f6905ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:24.257500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547ce82-52f4-4ffd-8dda-80d7f6905ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:24.257827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547ce82-52f4-4ffd-8dda-80d7f6905ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:24.259765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547ce82-52f4-4ffd-8dda-80d7f6905ad9 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:24.274809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 620/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:24.281490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e0256-bc2c-4943-9bc0-e12e08955b4b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:24.414584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e0256-bc2c-4943-9bc0-e12e08955b4b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:24.455289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ab2f2-6af6-4077-9ad5-1ad1c515cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:24.455962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ab2f2-6af6-4077-9ad5-1ad1c515cffc None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:24.456254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ab2f2-6af6-4077-9ad5-1ad1c515cffc None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:24.456599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ab2f2-6af6-4077-9ad5-1ad1c515cffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:24.457552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ab2f2-6af6-4077-9ad5-1ad1c515cffc None admin] RBAC: Adding query filter params (role.id=758fd66475334e07a52a5472784207a7, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=64ce422f60d64b368df8be61e1065282) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:24.457882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ab2f2-6af6-4077-9ad5-1ad1c515cffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:24.459669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ab2f2-6af6-4077-9ad5-1ad1c515cffc None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:24.482552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 626/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:24 2022] GET /identity/v3/role_assignments?user.id=64ce422f60d64b368df8be61e1065282&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=758fd66475334e07a52a5472784207a7 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:40:26.647868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b6662-d441-44d8-aece-032d5d3f11ab None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.648467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b6662-d441-44d8-aece-032d5d3f11ab None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.648566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b6662-d441-44d8-aece-032d5d3f11ab None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.649866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 621/1247] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:26.656248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5002e35-a98c-41e0-95d0-01ddddeb2f16 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.656747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5002e35-a98c-41e0-95d0-01ddddeb2f16 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.656877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5002e35-a98c-41e0-95d0-01ddddeb2f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.661933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:26.674659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c5002e35-a98c-41e0-95d0-01ddddeb2f16 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:26.675885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c5002e35-a98c-41e0-95d0-01ddddeb2f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:26.755229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 627/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:26.780015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b6662-d441-44d8-aece-032d5d3f11ab None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:26.799878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:26.904210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b6662-d441-44d8-aece-032d5d3f11ab None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:26.949895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd83b26-39ac-42e8-bdce-fbe02643ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:26.951004 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd83b26-39ac-42e8-bdce-fbe02643ae9c None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:26.951435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd83b26-39ac-42e8-bdce-fbe02643ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:26.951926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd83b26-39ac-42e8-bdce-fbe02643ae9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:26.967944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd83b26-39ac-42e8-bdce-fbe02643ae9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-9bd83b26-39ac-42e8-bdce-fbe02643ae9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:26.976517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:26.977893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:26.978984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 622/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:26.986143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5002e35-a98c-41e0-95d0-01ddddeb2f16 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.115847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5002e35-a98c-41e0-95d0-01ddddeb2f16 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.157320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.165222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6e528-f147-4609-b59d-ee47f06380af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.166164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6e528-f147-4609-b59d-ee47f06380af None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.166546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6e528-f147-4609-b59d-ee47f06380af None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.166915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6e528-f147-4609-b59d-ee47f06380af None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.167880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6e528-f147-4609-b59d-ee47f06380af None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:27.168316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6e528-f147-4609-b59d-ee47f06380af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.170028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6e528-f147-4609-b59d-ee47f06380af None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.182764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 628/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:27.191426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd83b26-39ac-42e8-bdce-fbe02643ae9c None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.298393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.335180 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd83b26-39ac-42e8-bdce-fbe02643ae9c None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.374096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f811-551f-4a7a-b48d-8e728d600d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.374859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f811-551f-4a7a-b48d-8e728d600d18 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.375144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f811-551f-4a7a-b48d-8e728d600d18 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.375424 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f811-551f-4a7a-b48d-8e728d600d18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.389457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866f811-551f-4a7a-b48d-8e728d600d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.391183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866f811-551f-4a7a-b48d-8e728d600d18 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-f866f811-551f-4a7a-b48d-8e728d600d18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:27.410956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:27.412152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:27.413643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:27.413643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:27.413643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:27.413643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:27.413643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 623/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:40:27.419220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6e528-f147-4609-b59d-ee47f06380af None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.540132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6e528-f147-4609-b59d-ee47f06380af None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.577701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3317407-2256-42a1-99ce-8fc23a2f6415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.578436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3317407-2256-42a1-99ce-8fc23a2f6415 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.578776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3317407-2256-42a1-99ce-8fc23a2f6415 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.579057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3317407-2256-42a1-99ce-8fc23a2f6415 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.579791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3317407-2256-42a1-99ce-8fc23a2f6415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:27.580101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3317407-2256-42a1-99ce-8fc23a2f6415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.581473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3317407-2256-42a1-99ce-8fc23a2f6415 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.595731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 629/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:27.602406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f811-551f-4a7a-b48d-8e728d600d18 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.722070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866f811-551f-4a7a-b48d-8e728d600d18 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.760831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.774947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eec9e-926b-4abc-8d02-77b5f847d38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.776011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eec9e-926b-4abc-8d02-77b5f847d38f None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.776451 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eec9e-926b-4abc-8d02-77b5f847d38f None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.776831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043eec9e-926b-4abc-8d02-77b5f847d38f None admin] PATH_INFO: `/v3/users/placement` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.786172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043eec9e-926b-4abc-8d02-77b5f847d38f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.787641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043eec9e-926b-4abc-8d02-77b5f847d38f None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-043eec9e-926b-4abc-8d02-77b5f847d38f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:27.806290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:27.807556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:27.808640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 624/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:27.814093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3317407-2256-42a1-99ce-8fc23a2f6415 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:27.881102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:27.936171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3317407-2256-42a1-99ce-8fc23a2f6415 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:27.979182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42b63-2375-48eb-92d1-82eb8b515696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:27.979592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42b63-2375-48eb-92d1-82eb8b515696 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:27.979880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42b63-2375-48eb-92d1-82eb8b515696 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:27.980160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b42b63-2375-48eb-92d1-82eb8b515696 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:27.981015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b42b63-2375-48eb-92d1-82eb8b515696 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:27.981332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b42b63-2375-48eb-92d1-82eb8b515696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:27.982898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b42b63-2375-48eb-92d1-82eb8b515696 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:28.001752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 630/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 23 10:40:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:28.008987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eec9e-926b-4abc-8d02-77b5f847d38f None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:28.135084 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043eec9e-926b-4abc-8d02-77b5f847d38f None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:28.182375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373048a5-b694-43b2-a5f4-cf8aa9e9037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:28.183498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373048a5-b694-43b2-a5f4-cf8aa9e9037b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:28.184000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373048a5-b694-43b2-a5f4-cf8aa9e9037b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:28.184471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373048a5-b694-43b2-a5f4-cf8aa9e9037b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:28.251679 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:28.266750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373048a5-b694-43b2-a5f4-cf8aa9e9037b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:28.268329 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373048a5-b694-43b2-a5f4-cf8aa9e9037b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:28.388484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 625/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:28.398438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42b63-2375-48eb-92d1-82eb8b515696 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:28.527228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b42b63-2375-48eb-92d1-82eb8b515696 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:28.541784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:28.567215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433aee-0306-484f-a2e4-5822b8c92a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:28.568072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433aee-0306-484f-a2e4-5822b8c92a07 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:28.568418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433aee-0306-484f-a2e4-5822b8c92a07 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:28.568724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433aee-0306-484f-a2e4-5822b8c92a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:28.580966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68433aee-0306-484f-a2e4-5822b8c92a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:28.582459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68433aee-0306-484f-a2e4-5822b8c92a07 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-68433aee-0306-484f-a2e4-5822b8c92a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:28.603095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:28.604473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:28.605420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:28.605420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:28.605420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:28.605420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:28.605420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 631/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:28.610845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373048a5-b694-43b2-a5f4-cf8aa9e9037b None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:28.707468 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:28.720878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373048a5-b694-43b2-a5f4-cf8aa9e9037b None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:28.758784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a4aba-95c7-4ed4-9708-ce11052b4d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:28.759635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a4aba-95c7-4ed4-9708-ce11052b4d2e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:28.759735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a4aba-95c7-4ed4-9708-ce11052b4d2e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:28.759966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a4aba-95c7-4ed4-9708-ce11052b4d2e None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:28.760689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a4aba-95c7-4ed4-9708-ce11052b4d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:28.760996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a4aba-95c7-4ed4-9708-ce11052b4d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:28.762541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a4aba-95c7-4ed4-9708-ce11052b4d2e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:28.776223 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 626/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:28.781822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433aee-0306-484f-a2e4-5822b8c92a07 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:28.894118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433aee-0306-484f-a2e4-5822b8c92a07 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:28.932285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229d945-7f4c-4dc5-85fa-eeaf51bd3f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:28.933147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229d945-7f4c-4dc5-85fa-eeaf51bd3f9b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:28.933429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229d945-7f4c-4dc5-85fa-eeaf51bd3f9b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:28.933715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229d945-7f4c-4dc5-85fa-eeaf51bd3f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:28.940634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229d945-7f4c-4dc5-85fa-eeaf51bd3f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:28.942403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229d945-7f4c-4dc5-85fa-eeaf51bd3f9b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-3229d945-7f4c-4dc5-85fa-eeaf51bd3f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:28.957410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:28.958476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:28.959886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:28.959886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:28.959886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:28.959886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:28.959886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:28.959886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:28.959886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:28.959886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:28.959886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 632/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:28.966010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a4aba-95c7-4ed4-9708-ce11052b4d2e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:29.086219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a4aba-95c7-4ed4-9708-ce11052b4d2e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:29.125683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e19b5-9197-419c-b917-463ed87ccc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:29.126402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e19b5-9197-419c-b917-463ed87ccc2b None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:29.126708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e19b5-9197-419c-b917-463ed87ccc2b None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:29.127038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e19b5-9197-419c-b917-463ed87ccc2b None admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:29.127896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e19b5-9197-419c-b917-463ed87ccc2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:29.128203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e19b5-9197-419c-b917-463ed87ccc2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:29.129760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e19b5-9197-419c-b917-463ed87ccc2b None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:29.144079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 627/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:29.151357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229d945-7f4c-4dc5-85fa-eeaf51bd3f9b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:29.182884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:29.267699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229d945-7f4c-4dc5-85fa-eeaf51bd3f9b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:29.308443 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c09e45-dd0a-44b7-bf40-685c218547b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:29.309128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09e45-dd0a-44b7-bf40-685c218547b5 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:29.309416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09e45-dd0a-44b7-bf40-685c218547b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:29.309700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c09e45-dd0a-44b7-bf40-685c218547b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:29.310584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c09e45-dd0a-44b7-bf40-685c218547b5 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=64ce422f60d64b368df8be61e1065282) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:29.310904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c09e45-dd0a-44b7-bf40-685c218547b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:29.312376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c09e45-dd0a-44b7-bf40-685c218547b5 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:29.318586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 633/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:29 2022] GET /identity/v3/role_assignments?user.id=64ce422f60d64b368df8be61e1065282&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:31.405820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497d9d-3719-4f1a-91cf-026b3750f12c None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.406389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497d9d-3719-4f1a-91cf-026b3750f12c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.406389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c497d9d-3719-4f1a-91cf-026b3750f12c None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.407786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 628/1261] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:31.413605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440beee9-c99f-4690-9cd9-432c63c2d9f5 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.414013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440beee9-c99f-4690-9cd9-432c63c2d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.414170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440beee9-c99f-4690-9cd9-432c63c2d9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.432076 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-440beee9-c99f-4690-9cd9-432c63c2d9f5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:31.433263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-440beee9-c99f-4690-9cd9-432c63c2d9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:31.497754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 634/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:31.520961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497d9d-3719-4f1a-91cf-026b3750f12c None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:31.532492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:31.625563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c497d9d-3719-4f1a-91cf-026b3750f12c None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.658842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6baea-8472-4d15-9038-107356316ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.659556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6baea-8472-4d15-9038-107356316ecc None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.659843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6baea-8472-4d15-9038-107356316ecc None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.660126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6baea-8472-4d15-9038-107356316ecc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.670103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6baea-8472-4d15-9038-107356316ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-85c6baea-8472-4d15-9038-107356316ecc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:31.677744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:31.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:31.680459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 629/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:31.685601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440beee9-c99f-4690-9cd9-432c63c2d9f5 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:31.704599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:31.782976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440beee9-c99f-4690-9cd9-432c63c2d9f5 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.816687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8cf6f-b4e6-43e8-8db7-8c693a767e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.817590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8cf6f-b4e6-43e8-8db7-8c693a767e27 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.817873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8cf6f-b4e6-43e8-8db7-8c693a767e27 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.818151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8cf6f-b4e6-43e8-8db7-8c693a767e27 None admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.818921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8cf6f-b4e6-43e8-8db7-8c693a767e27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:31.819767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8cf6f-b4e6-43e8-8db7-8c693a767e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.821158 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8cf6f-b4e6-43e8-8db7-8c693a767e27 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:31.829066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 635/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:31.834776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6baea-8472-4d15-9038-107356316ecc None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:31.902767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:31.937376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6baea-8472-4d15-9038-107356316ecc None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:31.969767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61dd19-ef13-472b-afbb-542471164e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:31.970569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61dd19-ef13-472b-afbb-542471164e3e None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:31.970852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61dd19-ef13-472b-afbb-542471164e3e None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:31.971130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61dd19-ef13-472b-afbb-542471164e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:31.982256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61dd19-ef13-472b-afbb-542471164e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:31.983729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61dd19-ef13-472b-afbb-542471164e3e None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-5e61dd19-ef13-472b-afbb-542471164e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:32.001248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:32.002373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:32.003356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:32.003356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:32.003356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:32.003356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:32.003356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 630/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:32.008915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8cf6f-b4e6-43e8-8db7-8c693a767e27 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.090816 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:32.110825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8cf6f-b4e6-43e8-8db7-8c693a767e27 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.152407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c99017-2662-4914-9a7e-0cad7cb4e37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.153079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c99017-2662-4914-9a7e-0cad7cb4e37a None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.153466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c99017-2662-4914-9a7e-0cad7cb4e37a None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.153653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c99017-2662-4914-9a7e-0cad7cb4e37a None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.154412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c99017-2662-4914-9a7e-0cad7cb4e37a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:32.154724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c99017-2662-4914-9a7e-0cad7cb4e37a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.156099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c99017-2662-4914-9a7e-0cad7cb4e37a None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.171582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 636/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:32.177287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61dd19-ef13-472b-afbb-542471164e3e None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.294161 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61dd19-ef13-472b-afbb-542471164e3e None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.314621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:32.329261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dd0b0-a206-47e8-a3e6-b0b5edc0d2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.330062 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dd0b0-a206-47e8-a3e6-b0b5edc0d2cb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.330369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dd0b0-a206-47e8-a3e6-b0b5edc0d2cb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.330651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dd0b0-a206-47e8-a3e6-b0b5edc0d2cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.339543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dd0b0-a206-47e8-a3e6-b0b5edc0d2cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.341025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dd0b0-a206-47e8-a3e6-b0b5edc0d2cb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-6b4dd0b0-a206-47e8-a3e6-b0b5edc0d2cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:32.357926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:32.359539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:32.360783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 631/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:32.365022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c99017-2662-4914-9a7e-0cad7cb4e37a None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.468747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c99017-2662-4914-9a7e-0cad7cb4e37a None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.503225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2375c5-bc8c-4c47-8963-ecf41b89ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.503883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2375c5-bc8c-4c47-8963-ecf41b89ee26 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.504168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2375c5-bc8c-4c47-8963-ecf41b89ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.504444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2375c5-bc8c-4c47-8963-ecf41b89ee26 None admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.505268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2375c5-bc8c-4c47-8963-ecf41b89ee26 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:32.505577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2375c5-bc8c-4c47-8963-ecf41b89ee26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.507789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2375c5-bc8c-4c47-8963-ecf41b89ee26 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.516450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:32.525177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 637/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 23 10:40:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:32.530641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dd0b0-a206-47e8-a3e6-b0b5edc0d2cb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.631686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dd0b0-a206-47e8-a3e6-b0b5edc0d2cb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.666888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63aa06-dd32-4130-b6c3-17543914b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.667668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63aa06-dd32-4130-b6c3-17543914b6aa None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.667953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63aa06-dd32-4130-b6c3-17543914b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.668232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63aa06-dd32-4130-b6c3-17543914b6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.679272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63aa06-dd32-4130-b6c3-17543914b6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.680643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63aa06-dd32-4130-b6c3-17543914b6aa None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-db63aa06-dd32-4130-b6c3-17543914b6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:32.697499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:32.698493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:32.699531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:32.699531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:32.699531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:32.699531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:32.699531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 632/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:32.704444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2375c5-bc8c-4c47-8963-ecf41b89ee26 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.802863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2375c5-bc8c-4c47-8963-ecf41b89ee26 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.836770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147dc9e-7639-4f40-8384-0f17824361da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.837419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147dc9e-7639-4f40-8384-0f17824361da None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.837702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147dc9e-7639-4f40-8384-0f17824361da None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.837980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147dc9e-7639-4f40-8384-0f17824361da None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:32.838730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147dc9e-7639-4f40-8384-0f17824361da None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:32.839036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147dc9e-7639-4f40-8384-0f17824361da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:32.840394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147dc9e-7639-4f40-8384-0f17824361da None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:32.851363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 638/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:32.857025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63aa06-dd32-4130-b6c3-17543914b6aa None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:32.888858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:32.960661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63aa06-dd32-4130-b6c3-17543914b6aa None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:32.994256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b922e-7ae2-47ed-b3d3-b003691a59d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:32.995069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b922e-7ae2-47ed-b3d3-b003691a59d5 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:32.995356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b922e-7ae2-47ed-b3d3-b003691a59d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:32.995634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b922e-7ae2-47ed-b3d3-b003691a59d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.002274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b922e-7ae2-47ed-b3d3-b003691a59d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:33.003748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b922e-7ae2-47ed-b3d3-b003691a59d5 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-c42b922e-7ae2-47ed-b3d3-b003691a59d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:33.017651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:33.018788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:33.019946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:33.019946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:33.019946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:33.019946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:33.019946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:33.019946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:33.019946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:33.019946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:33.019946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 633/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:33.025618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147dc9e-7639-4f40-8384-0f17824361da None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:33.083007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:33.125078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147dc9e-7639-4f40-8384-0f17824361da None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:33.164416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ca8c5-06f9-4357-a318-64553e3e5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:33.165002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca8c5-06f9-4357-a318-64553e3e5689 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.165307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca8c5-06f9-4357-a318-64553e3e5689 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.165567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca8c5-06f9-4357-a318-64553e3e5689 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.166379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ca8c5-06f9-4357-a318-64553e3e5689 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:33.166844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ca8c5-06f9-4357-a318-64553e3e5689 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:33.168346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ca8c5-06f9-4357-a318-64553e3e5689 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:33.180823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 639/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:33.186769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b922e-7ae2-47ed-b3d3-b003691a59d5 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:33.277771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:33.286531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b922e-7ae2-47ed-b3d3-b003691a59d5 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:33.321621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4be5-aee3-4aa9-be1c-043364ee0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:33.322526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4be5-aee3-4aa9-be1c-043364ee0110 None admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:33.322814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4be5-aee3-4aa9-be1c-043364ee0110 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:33.323090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4be5-aee3-4aa9-be1c-043364ee0110 None admin] PATH_INFO: `/v3/projects/8bb8e755bc874373b86cddae63b92654/users/64ce422f60d64b368df8be61e1065282/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:33.325032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca4be5-aee3-4aa9-be1c-043364ee0110 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bb8e755bc874373b86cddae63b92654, user_id=64ce422f60d64b368df8be61e1065282, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:33.326635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca4be5-aee3-4aa9-be1c-043364ee0110 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:33.339078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 634/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jun 23 10:40:33 2022] PUT /identity/v3/projects/8bb8e755bc874373b86cddae63b92654/users/64ce422f60d64b368df8be61e1065282/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:40:35.378654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3f2d-6fe5-4ddd-8e13-ce379b06518a None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.379193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3f2d-6fe5-4ddd-8e13-ce379b06518a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.379193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e3f2d-6fe5-4ddd-8e13-ce379b06518a None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.380563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 640/1274] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:35.386357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7141f-c248-4a51-8c17-68928c47f780 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.386778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7141f-c248-4a51-8c17-68928c47f780 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.386922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7141f-c248-4a51-8c17-68928c47f780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.404613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-58e7141f-c248-4a51-8c17-68928c47f780 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:35.405854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-58e7141f-c248-4a51-8c17-68928c47f780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:35.474083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 635/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:35.500077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e3f2d-6fe5-4ddd-8e13-ce379b06518a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:35.603429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e3f2d-6fe5-4ddd-8e13-ce379b06518a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:35.620251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:35.637635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cddee-23d9-4370-84cd-b51b4198a08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:35.638372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cddee-23d9-4370-84cd-b51b4198a08d None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.638659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cddee-23d9-4370-84cd-b51b4198a08d None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.638939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cddee-23d9-4370-84cd-b51b4198a08d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.649304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cddee-23d9-4370-84cd-b51b4198a08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-5a6cddee-23d9-4370-84cd-b51b4198a08d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:40:35.656831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:35.657932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:35.659199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 641/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jun 23 10:40:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:35.664087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7141f-c248-4a51-8c17-68928c47f780 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:35.742844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:35.763402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7141f-c248-4a51-8c17-68928c47f780 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:35.798461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7597c4-240a-4d7b-bf2e-b9705f612749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:35.799128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7597c4-240a-4d7b-bf2e-b9705f612749 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.799408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7597c4-240a-4d7b-bf2e-b9705f612749 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.799685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7597c4-240a-4d7b-bf2e-b9705f612749 None admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.800434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7597c4-240a-4d7b-bf2e-b9705f612749 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:35.800850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7597c4-240a-4d7b-bf2e-b9705f612749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:35.802240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7597c4-240a-4d7b-bf2e-b9705f612749 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:35.810925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 636/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jun 23 10:40:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:35.816674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cddee-23d9-4370-84cd-b51b4198a08d None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:35.922684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cddee-23d9-4370-84cd-b51b4198a08d None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:35.960476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9b413-ad61-47f8-8c26-b6bd99504408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:35.961930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9b413-ad61-47f8-8c26-b6bd99504408 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:35.962216 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9b413-ad61-47f8-8c26-b6bd99504408 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:35.962526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9b413-ad61-47f8-8c26-b6bd99504408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:35.973439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9b413-ad61-47f8-8c26-b6bd99504408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:35.974925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9b413-ad61-47f8-8c26-b6bd99504408 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-d3a9b413-ad61-47f8-8c26-b6bd99504408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:35.993494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:35.994654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:35.995691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:35.995691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:35.995691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:35.995691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:35.995691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 642/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:36.000509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7597c4-240a-4d7b-bf2e-b9705f612749 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.105949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7597c4-240a-4d7b-bf2e-b9705f612749 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.141016 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639d80b-6ade-41bc-bf2c-cda7af070fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.141651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639d80b-6ade-41bc-bf2c-cda7af070fde None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.141936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639d80b-6ade-41bc-bf2c-cda7af070fde None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.142215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639d80b-6ade-41bc-bf2c-cda7af070fde None admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.142979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639d80b-6ade-41bc-bf2c-cda7af070fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:36.143287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639d80b-6ade-41bc-bf2c-cda7af070fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.144661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639d80b-6ade-41bc-bf2c-cda7af070fde None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.158731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 637/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:36.166098 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9b413-ad61-47f8-8c26-b6bd99504408 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.198817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.265995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9b413-ad61-47f8-8c26-b6bd99504408 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.299095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb5054-dd92-4fc1-90a7-1b1282ece562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.299879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5054-dd92-4fc1-90a7-1b1282ece562 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.300157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5054-dd92-4fc1-90a7-1b1282ece562 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.300429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb5054-dd92-4fc1-90a7-1b1282ece562 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.308056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb5054-dd92-4fc1-90a7-1b1282ece562 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.309480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb5054-dd92-4fc1-90a7-1b1282ece562 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-acbb5054-dd92-4fc1-90a7-1b1282ece562 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:40:36.323527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:36.324651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:36.325746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 643/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:36.330506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639d80b-6ade-41bc-bf2c-cda7af070fde None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.334253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.434857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639d80b-6ade-41bc-bf2c-cda7af070fde None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.469101 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a7dbb-f52d-4679-b941-69c7ad1d92cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.469694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a7dbb-f52d-4679-b941-69c7ad1d92cb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.469975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a7dbb-f52d-4679-b941-69c7ad1d92cb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.470251 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a7dbb-f52d-4679-b941-69c7ad1d92cb None admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.471136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a7dbb-f52d-4679-b941-69c7ad1d92cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:36.471449 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a7dbb-f52d-4679-b941-69c7ad1d92cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.472914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a7dbb-f52d-4679-b941-69c7ad1d92cb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.494085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 638/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:36.500635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb5054-dd92-4fc1-90a7-1b1282ece562 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.595806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.606653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb5054-dd92-4fc1-90a7-1b1282ece562 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.640621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4387f2-d616-49ca-9847-0ef393db4eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.641255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4387f2-d616-49ca-9847-0ef393db4eeb None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.641533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4387f2-d616-49ca-9847-0ef393db4eeb None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.641808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4387f2-d616-49ca-9847-0ef393db4eeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.708332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4387f2-d616-49ca-9847-0ef393db4eeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.710658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4387f2-d616-49ca-9847-0ef393db4eeb None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.796576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.807469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 644/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:40:36.813398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a7dbb-f52d-4679-b941-69c7ad1d92cb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:36.875755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:36.914539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a7dbb-f52d-4679-b941-69c7ad1d92cb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:36.949561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7049dc-4432-420d-a894-667d580e46eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:36.950364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7049dc-4432-420d-a894-667d580e46eb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:36.950658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7049dc-4432-420d-a894-667d580e46eb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:36.950939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7049dc-4432-420d-a894-667d580e46eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:36.961105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7049dc-4432-420d-a894-667d580e46eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:36.962588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7049dc-4432-420d-a894-667d580e46eb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-3c7049dc-4432-420d-a894-667d580e46eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:40:36.979768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:36.980832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:36.981773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:40:36.981773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:40:36.981773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:40:36.981773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:36.981773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 639/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:36.986734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4387f2-d616-49ca-9847-0ef393db4eeb None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:37.093461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4387f2-d616-49ca-9847-0ef393db4eeb None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:37.130658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6dc3-48a2-4608-909f-7e34b2100216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:37.131320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6dc3-48a2-4608-909f-7e34b2100216 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:37.132123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6dc3-48a2-4608-909f-7e34b2100216 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:37.132448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e6dc3-48a2-4608-909f-7e34b2100216 None admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:37.133406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6dc3-48a2-4608-909f-7e34b2100216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:37.133629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6dc3-48a2-4608-909f-7e34b2100216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:37.135037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e6dc3-48a2-4608-909f-7e34b2100216 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:37.147018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 645/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jun 23 10:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:37.154027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7049dc-4432-420d-a894-667d580e46eb None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:37.254235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7049dc-4432-420d-a894-667d580e46eb None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:37.269622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:37.290002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87b8e7-2667-4e9c-83f7-6e541e6638b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:37.290822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b8e7-2667-4e9c-83f7-6e541e6638b8 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:37.291109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b8e7-2667-4e9c-83f7-6e541e6638b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:37.291389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b8e7-2667-4e9c-83f7-6e541e6638b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:37.297996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87b8e7-2667-4e9c-83f7-6e541e6638b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:37.299474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87b8e7-2667-4e9c-83f7-6e541e6638b8 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application [None req-7f87b8e7-2667-4e9c-83f7-6e541e6638b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:40:37.313023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:37.314065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:37.315155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:40:37.315155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:40:37.315155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:40:37.315155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:40:37.315155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:40:37.315155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:40:37.315155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:40:37.315155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: ERROR keystone.server.flask.application Jun 23 10:40:37.315155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 640/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jun 23 10:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:37.320893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6dc3-48a2-4608-909f-7e34b2100216 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:37.371429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:37.420467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e6dc3-48a2-4608-909f-7e34b2100216 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:37.453321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea132ff-10ac-4dc4-b1a5-0e1ad88c2827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:37.453967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea132ff-10ac-4dc4-b1a5-0e1ad88c2827 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:37.454253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea132ff-10ac-4dc4-b1a5-0e1ad88c2827 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:37.454561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea132ff-10ac-4dc4-b1a5-0e1ad88c2827 None admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:37.455352 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea132ff-10ac-4dc4-b1a5-0e1ad88c2827 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:37.455667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea132ff-10ac-4dc4-b1a5-0e1ad88c2827 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:37.457095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea132ff-10ac-4dc4-b1a5-0e1ad88c2827 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:37.469059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 646/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jun 23 10:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:37.475120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87b8e7-2667-4e9c-83f7-6e541e6638b8 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:37.578707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87b8e7-2667-4e9c-83f7-6e541e6638b8 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:37.612364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82e84c-f070-49ad-8510-3ae63a756919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:37.613002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82e84c-f070-49ad-8510-3ae63a756919 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:37.613287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82e84c-f070-49ad-8510-3ae63a756919 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:37.613565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82e84c-f070-49ad-8510-3ae63a756919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:37.614412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82e84c-f070-49ad-8510-3ae63a756919 None admin] RBAC: Adding query filter params (role.id=2ca403234d1f4c32ba32cda2ff64228f, scope.project.id=8bb8e755bc874373b86cddae63b92654, user.id=64ce422f60d64b368df8be61e1065282) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:37.614729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82e84c-f070-49ad-8510-3ae63a756919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:37.616322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82e84c-f070-49ad-8510-3ae63a756919 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:37.622173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 641/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jun 23 10:40:37 2022] GET /identity/v3/role_assignments?user.id=64ce422f60d64b368df8be61e1065282&scope.project.id=8bb8e755bc874373b86cddae63b92654&role.id=2ca403234d1f4c32ba32cda2ff64228f => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:39.730633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52327-4e44-4992-874e-7de45026c27d None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.731324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52327-4e44-4992-874e-7de45026c27d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.731324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd52327-4e44-4992-874e-7de45026c27d None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.732568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 647/1288] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:39.737884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa8c0-81a3-4880-aa5a-d2f77d400c9d None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.738334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa8c0-81a3-4880-aa5a-d2f77d400c9d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.738485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2aa8c0-81a3-4880-aa5a-d2f77d400c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.756614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-5f2aa8c0-81a3-4880-aa5a-d2f77d400c9d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:39.758537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5f2aa8c0-81a3-4880-aa5a-d2f77d400c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:39.790563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:39.829178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 642/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:39.852894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd52327-4e44-4992-874e-7de45026c27d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:39.958208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd52327-4e44-4992-874e-7de45026c27d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:39.969826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:39.994520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fab78-a9ff-4969-80c2-5ef0f39610cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:39.995318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fab78-a9ff-4969-80c2-5ef0f39610cb None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:39.995604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fab78-a9ff-4969-80c2-5ef0f39610cb None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:39.995886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fab78-a9ff-4969-80c2-5ef0f39610cb None admin] PATH_INFO: `/v3/services/placement` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:39.996543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fab78-a9ff-4969-80c2-5ef0f39610cb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:39.997908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fab78-a9ff-4969-80c2-5ef0f39610cb None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-a50fab78-a9ff-4969-80c2-5ef0f39610cb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:40.010499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:40.011820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:40.012729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 648/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:40:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:40.017978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa8c0-81a3-4880-aa5a-d2f77d400c9d None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:40.132809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2aa8c0-81a3-4880-aa5a-d2f77d400c9d None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:40.170152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae34ec0-ff55-458f-bfeb-ecbbda5ac889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:40.170906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae34ec0-ff55-458f-bfeb-ecbbda5ac889 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:40.171235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae34ec0-ff55-458f-bfeb-ecbbda5ac889 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:40.171536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae34ec0-ff55-458f-bfeb-ecbbda5ac889 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:40.172303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae34ec0-ff55-458f-bfeb-ecbbda5ac889 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:40.172628 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae34ec0-ff55-458f-bfeb-ecbbda5ac889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:40.174146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae34ec0-ff55-458f-bfeb-ecbbda5ac889 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.180510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 643/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 23 10:40:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:40.186342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fab78-a9ff-4969-80c2-5ef0f39610cb None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:40.293862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fab78-a9ff-4969-80c2-5ef0f39610cb None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:40.329266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69a810-75dc-4a3c-b5e2-a2015e176ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:40.329926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69a810-75dc-4a3c-b5e2-a2015e176ce0 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:40.330208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69a810-75dc-4a3c-b5e2-a2015e176ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:40.330521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69a810-75dc-4a3c-b5e2-a2015e176ce0 None admin] PATH_INFO: `/v3/services` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:40.331227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69a810-75dc-4a3c-b5e2-a2015e176ce0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:40.331538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69a810-75dc-4a3c-b5e2-a2015e176ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:40.332900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69a810-75dc-4a3c-b5e2-a2015e176ce0 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:40.338060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 649/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 23 10:40:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:42.432607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016732-8b25-4b12-a31d-f572033c2416 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.433150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016732-8b25-4b12-a31d-f572033c2416 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.433150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50016732-8b25-4b12-a31d-f572033c2416 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.434549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 644/1293] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:42.439671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0517bb-905c-421c-9913-a246c56aabb0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.440087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0517bb-905c-421c-9913-a246c56aabb0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.440233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0517bb-905c-421c-9913-a246c56aabb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.458246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2a0517bb-905c-421c-9913-a246c56aabb0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:42.459483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2a0517bb-905c-421c-9913-a246c56aabb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:42.489723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:42.530160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 650/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:42.554168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50016732-8b25-4b12-a31d-f572033c2416 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:42.586519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:42.658038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50016732-8b25-4b12-a31d-f572033c2416 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:42.693212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d00e1-1426-4529-ab25-6d9760a0a6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:42.693789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d00e1-1426-4529-ab25-6d9760a0a6f0 None admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:42.694102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d00e1-1426-4529-ab25-6d9760a0a6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:42.694614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d00e1-1426-4529-ab25-6d9760a0a6f0 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:42.695496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d00e1-1426-4529-ab25-6d9760a0a6f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:42.696888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d00e1-1426-4529-ab25-6d9760a0a6f0 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:42.710230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 645/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jun 23 10:40:42 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:44.779792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6f453-9736-4223-b933-4b51ab708e54 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:44.780320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6f453-9736-4223-b933-4b51ab708e54 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:44.780408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6f453-9736-4223-b933-4b51ab708e54 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:44.781709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 651/1296] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:44.787039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91cba7-f6ed-4fd9-b3d5-ce5249b5170a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:44.787493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91cba7-f6ed-4fd9-b3d5-ce5249b5170a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:44.787588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91cba7-f6ed-4fd9-b3d5-ce5249b5170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:44.805696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7f91cba7-f6ed-4fd9-b3d5-ce5249b5170a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:44.806847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7f91cba7-f6ed-4fd9-b3d5-ce5249b5170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:44.880362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 646/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:44.903195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6f453-9736-4223-b933-4b51ab708e54 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.003610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6f453-9736-4223-b933-4b51ab708e54 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.037244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c62fb5-ae34-4f0a-b37b-34211281591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.038611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c62fb5-ae34-4f0a-b37b-34211281591b None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.038897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c62fb5-ae34-4f0a-b37b-34211281591b None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.039177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c62fb5-ae34-4f0a-b37b-34211281591b None admin] PATH_INFO: `/v3/services/placement` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.039828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c62fb5-ae34-4f0a-b37b-34211281591b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.041198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c62fb5-ae34-4f0a-b37b-34211281591b None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-61c62fb5-ae34-4f0a-b37b-34211281591b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:45.052876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:45.054113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:45.056033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 652/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:40:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:45.060228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91cba7-f6ed-4fd9-b3d5-ce5249b5170a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.081949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:45.169510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91cba7-f6ed-4fd9-b3d5-ce5249b5170a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.203401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f796c-7df6-47cd-a302-5bdbd2456184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.204061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f796c-7df6-47cd-a302-5bdbd2456184 None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.204347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f796c-7df6-47cd-a302-5bdbd2456184 None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.204629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f796c-7df6-47cd-a302-5bdbd2456184 None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.205332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f796c-7df6-47cd-a302-5bdbd2456184 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:45.205641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f796c-7df6-47cd-a302-5bdbd2456184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.207041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f796c-7df6-47cd-a302-5bdbd2456184 None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.213289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 647/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:45.219214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c62fb5-ae34-4f0a-b37b-34211281591b None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.249886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:45.319500 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c62fb5-ae34-4f0a-b37b-34211281591b None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.353650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e561d36-53bb-4744-9b92-f5bc1cdfe032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.354309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561d36-53bb-4744-9b92-f5bc1cdfe032 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.354626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561d36-53bb-4744-9b92-f5bc1cdfe032 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.354907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e561d36-53bb-4744-9b92-f5bc1cdfe032 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.355702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561d36-53bb-4744-9b92-f5bc1cdfe032 None admin] RBAC: Adding query filter params (interface=public, service_id=918be7d3b28340f2beed60f8e441f0b3, region_id=RegionOne) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:45.356019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561d36-53bb-4744-9b92-f5bc1cdfe032 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.357395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e561d36-53bb-4744-9b92-f5bc1cdfe032 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.362716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 653/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/endpoints?service_id=918be7d3b28340f2beed60f8e441f0b3&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:45.368528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f796c-7df6-47cd-a302-5bdbd2456184 None admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:45.458713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:45.478118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f796c-7df6-47cd-a302-5bdbd2456184 None admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:45.515284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c0f94-76ee-4af6-90de-0eedad95f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:45.515946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c0f94-76ee-4af6-90de-0eedad95f8bb None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:45.516233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c0f94-76ee-4af6-90de-0eedad95f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:45.516523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c0f94-76ee-4af6-90de-0eedad95f8bb None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:45.517210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c0f94-76ee-4af6-90de-0eedad95f8bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:45.518620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c0f94-76ee-4af6-90de-0eedad95f8bb None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:45.526454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 648/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jun 23 10:40:45 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:40:47.561464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd0f7-a4db-4b2a-beca-19fbc096c296 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:47.562009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd0f7-a4db-4b2a-beca-19fbc096c296 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:47.562009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cd0f7-a4db-4b2a-beca-19fbc096c296 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:47.563447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 654/1302] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:40:47.569527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f907faf-7211-4713-b95a-e84845e4cc31 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:47.571711 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f907faf-7211-4713-b95a-e84845e4cc31 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:47.572001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f907faf-7211-4713-b95a-e84845e4cc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:47.589149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7f907faf-7211-4713-b95a-e84845e4cc31 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:40:47.590384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7f907faf-7211-4713-b95a-e84845e4cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:40:47.665770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 649/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:40:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:40:47.688692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd0f7-a4db-4b2a-beca-19fbc096c296 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:47.794045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:47.801265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cd0f7-a4db-4b2a-beca-19fbc096c296 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:47.836008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd8f5f-ea9e-4b25-b4a4-a2f7831bdcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:47.836803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd8f5f-ea9e-4b25-b4a4-a2f7831bdcf5 None admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:47.837083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd8f5f-ea9e-4b25-b4a4-a2f7831bdcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:47.837356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd8f5f-ea9e-4b25-b4a4-a2f7831bdcf5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:47.838003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd8f5f-ea9e-4b25-b4a4-a2f7831bdcf5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:47.839403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd8f5f-ea9e-4b25-b4a4-a2f7831bdcf5 None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application [None req-b3dd8f5f-ea9e-4b25-b4a4-a2f7831bdcf5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:40:47.859347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:40:47.860614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application with Lock( Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: ERROR keystone.server.flask.application Jun 23 10:40:47.861644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 655/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jun 23 10:40:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:40:47.868160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f907faf-7211-4713-b95a-e84845e4cc31 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:47.947282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:47.971285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f907faf-7211-4713-b95a-e84845e4cc31 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:48.006193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b64402-866b-4668-af78-6d79c8f8871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:48.007299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64402-866b-4668-af78-6d79c8f8871a None admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.007585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64402-866b-4668-af78-6d79c8f8871a None admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.007866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b64402-866b-4668-af78-6d79c8f8871a None admin] PATH_INFO: `/v3/services` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.008575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b64402-866b-4668-af78-6d79c8f8871a None admin] RBAC: Adding query filter params (name=placement) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:40:48.008886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b64402-866b-4668-af78-6d79c8f8871a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:48.010274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b64402-866b-4668-af78-6d79c8f8871a None admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:48.015628 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 650/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jun 23 10:40:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:40:48.022828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd8f5f-ea9e-4b25-b4a4-a2f7831bdcf5 None admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:40:48.128875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd8f5f-ea9e-4b25-b4a4-a2f7831bdcf5 None admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:40:48.169448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c6b90-fbef-4cbf-b81d-e79e6cd823ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:40:48.170111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c6b90-fbef-4cbf-b81d-e79e6cd823ad None admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:40:48.170423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c6b90-fbef-4cbf-b81d-e79e6cd823ad None admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:40:48.170748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c6b90-fbef-4cbf-b81d-e79e6cd823ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:40:48.171454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c6b90-fbef-4cbf-b81d-e79e6cd823ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:40:48.172831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c6b90-fbef-4cbf-b81d-e79e6cd823ad None admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:40:48.198882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 656/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jun 23 10:40:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:40:58.014765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=30 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:40:58.188479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:53.191440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6bc1f-3e94-48b7-af3a-ec0ec0d86cc4 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:53.192519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6bc1f-3e94-48b7-af3a-ec0ec0d86cc4 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:53.193960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6bc1f-3e94-48b7-af3a-ec0ec0d86cc4 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:53.195700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 651/1307] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:41:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:53.201333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51e5e-c064-40ee-a635-f85b6c2f6fe6 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:53.201811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51e5e-c064-40ee-a635-f85b6c2f6fe6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:53.201892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51e5e-c064-40ee-a635-f85b6c2f6fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:53.292453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a4a51e5e-c064-40ee-a635-f85b6c2f6fe6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:53.293714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a4a51e5e-c064-40ee-a635-f85b6c2f6fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:53.426661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 657/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:41:53.476949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9801d4-75e1-4906-baf3-a4c2036c732f None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:53.477374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9801d4-75e1-4906-baf3-a4c2036c732f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:53.477566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9801d4-75e1-4906-baf3-a4c2036c732f None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:53.478919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 652/1309] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jun 23 10:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:53.494013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29714-5f14-47ee-b54e-4d654766620e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:53.494214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29714-5f14-47ee-b54e-4d654766620e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:53.494524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c29714-5f14-47ee-b54e-4d654766620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:53.593046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-73c29714-5f14-47ee-b54e-4d654766620e None None] MFA Rules not processed for user `ed8f21a950d6483abc7ab67fb533942a`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:53.594283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-73c29714-5f14-47ee-b54e-4d654766620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:53.621077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:53.699910 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 658/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jun 23 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:41:53.722280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9801d4-75e1-4906-baf3-a4c2036c732f None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:53.724802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8e9801d4-75e1-4906-baf3-a4c2036c732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:53.897569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9801d4-75e1-4906-baf3-a4c2036c732f None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:53.996512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e34607-471a-4b48-bb71-9340b33a4ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:53.997205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e34607-471a-4b48-bb71-9340b33a4ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:53.997553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e34607-471a-4b48-bb71-9340b33a4ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:53.998032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e34607-471a-4b48-bb71-9340b33a4ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:53.999826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f3e34607-471a-4b48-bb71-9340b33a4ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:54.086121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:54.168819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e34607-471a-4b48-bb71-9340b33a4ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:54.170469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e34607-471a-4b48-bb71-9340b33a4ce3 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:54.195763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 653/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:41:56.640123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1929a-5ab2-440d-9cd1-faaf8e2be9f2 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:56.640663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1929a-5ab2-440d-9cd1-faaf8e2be9f2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:56.640757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1929a-5ab2-440d-9cd1-faaf8e2be9f2 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:56.642163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 659/1312] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:56.648773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d823dd-96cb-4f93-933c-3fe46a8fde94 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:56.649427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d823dd-96cb-4f93-933c-3fe46a8fde94 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:56.649427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d823dd-96cb-4f93-933c-3fe46a8fde94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:56.736912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f3d823dd-96cb-4f93-933c-3fe46a8fde94 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:56.738479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f3d823dd-96cb-4f93-933c-3fe46a8fde94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:56.864085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 654/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:41:56.905498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1929a-5ab2-440d-9cd1-faaf8e2be9f2 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:56.907141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b5b1929a-5ab2-440d-9cd1-faaf8e2be9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:57.030066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1929a-5ab2-440d-9cd1-faaf8e2be9f2 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:41:57.107310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:57.109985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c1afd-9623-4a83-b499-994fc2908436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:41:57.110868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1afd-9623-4a83-b499-994fc2908436 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:57.111224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1afd-9623-4a83-b499-994fc2908436 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:57.111713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c1afd-9623-4a83-b499-994fc2908436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:57.113671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5e6c1afd-9623-4a83-b499-994fc2908436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:57.287476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c1afd-9623-4a83-b499-994fc2908436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:41:57.289969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c1afd-9623-4a83-b499-994fc2908436 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:41:57.325168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 660/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:41:59.768298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068481a9-d95d-4fba-b7a6-811b5b220e6d None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:59.768866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068481a9-d95d-4fba-b7a6-811b5b220e6d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:59.768866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068481a9-d95d-4fba-b7a6-811b5b220e6d None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:59.770250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 655/1315] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:41:59.776017 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044334b1-64ef-447d-8818-213f3d639db3 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:41:59.776494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044334b1-64ef-447d-8818-213f3d639db3 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:41:59.776609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044334b1-64ef-447d-8818-213f3d639db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:41:59.843906 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-044334b1-64ef-447d-8818-213f3d639db3 None None] MFA Rules not processed for user `ec4709eda5dd45ea8a9d35bf7da1f22b`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:41:59.845135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-044334b1-64ef-447d-8818-213f3d639db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:41:59.900696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:41:59.948467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 661/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:41:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:41:59.991114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068481a9-d95d-4fba-b7a6-811b5b220e6d None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:41:59.992674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-068481a9-d95d-4fba-b7a6-811b5b220e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:00.002709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:00.100051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068481a9-d95d-4fba-b7a6-811b5b220e6d None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:00.175731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6a5fa-8214-4d11-9066-daef65d5a423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:00.176494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a5fa-8214-4d11-9066-daef65d5a423 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:00.176777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a5fa-8214-4d11-9066-daef65d5a423 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:00.177113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6a5fa-8214-4d11-9066-daef65d5a423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:00.178937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c5c6a5fa-8214-4d11-9066-daef65d5a423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:00.244491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:00.297864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6a5fa-8214-4d11-9066-daef65d5a423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:00.299355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6a5fa-8214-4d11-9066-daef65d5a423 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:00.319578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 656/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:41:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:02.972662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901211fa-7018-41c4-adfc-de62b66e8ab0 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:02.973195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901211fa-7018-41c4-adfc-de62b66e8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:02.973313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901211fa-7018-41c4-adfc-de62b66e8ab0 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:02.974953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 662/1318] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:02.980540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2d246-a53f-4b27-88cb-ea4443cf4109 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:02.981049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2d246-a53f-4b27-88cb-ea4443cf4109 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:02.981154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2d246-a53f-4b27-88cb-ea4443cf4109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:03.052892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-5ed2d246-a53f-4b27-88cb-ea4443cf4109 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:03.054156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5ed2d246-a53f-4b27-88cb-ea4443cf4109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:03.170855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 657/1319] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:03.210779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901211fa-7018-41c4-adfc-de62b66e8ab0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:03.212366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-901211fa-7018-41c4-adfc-de62b66e8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:03.320703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901211fa-7018-41c4-adfc-de62b66e8ab0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:03.395050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93460-e886-4830-b8af-78a212adf0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:03.395701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93460-e886-4830-b8af-78a212adf0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:03.395990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93460-e886-4830-b8af-78a212adf0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:03.396273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93460-e886-4830-b8af-78a212adf0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:03.397999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b4d93460-e886-4830-b8af-78a212adf0a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:03.409643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:03.523448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93460-e886-4830-b8af-78a212adf0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:03.524865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93460-e886-4830-b8af-78a212adf0a4 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:03.549214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 663/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:06.363686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c934d23-729c-4c09-94a0-3974bc5e8fd6 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:06.364234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c934d23-729c-4c09-94a0-3974bc5e8fd6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:06.364359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c934d23-729c-4c09-94a0-3974bc5e8fd6 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:06.365985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 658/1321] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:06.371261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a64e-ca49-4304-9c20-d070d771937d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:06.371702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a64e-ca49-4304-9c20-d070d771937d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:06.371826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a64e-ca49-4304-9c20-d070d771937d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:06.441214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-92f1a64e-ca49-4304-9c20-d070d771937d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:06.442475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-92f1a64e-ca49-4304-9c20-d070d771937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:06.502385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:06.553238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 664/1322] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:06.589720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c934d23-729c-4c09-94a0-3974bc5e8fd6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:06.591376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9c934d23-729c-4c09-94a0-3974bc5e8fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:06.614508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:06.717323 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c934d23-729c-4c09-94a0-3974bc5e8fd6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:06.797450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28cf44-ba18-486a-8726-9e172dc257e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:06.798091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28cf44-ba18-486a-8726-9e172dc257e3 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:06.798404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28cf44-ba18-486a-8726-9e172dc257e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:06.798685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28cf44-ba18-486a-8726-9e172dc257e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:06.800336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7f28cf44-ba18-486a-8726-9e172dc257e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:06.876786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:06.919264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28cf44-ba18-486a-8726-9e172dc257e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:06.920714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28cf44-ba18-486a-8726-9e172dc257e3 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:06.939488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 659/1323] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:09.062524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988825f-150d-47f0-b6b6-a829d7e802e2 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:09.063053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988825f-150d-47f0-b6b6-a829d7e802e2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:09.063163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988825f-150d-47f0-b6b6-a829d7e802e2 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:09.064586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 665/1324] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:09.070222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef552e8f-2f18-4568-a577-51b1d6b96ced None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:09.070674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef552e8f-2f18-4568-a577-51b1d6b96ced None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:09.070959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef552e8f-2f18-4568-a577-51b1d6b96ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:09.140572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ef552e8f-2f18-4568-a577-51b1d6b96ced None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:09.141809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ef552e8f-2f18-4568-a577-51b1d6b96ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:09.248089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 660/1325] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:09.298499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d374-5540-42fe-ab8b-4691f15734e0 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:09.298792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d374-5540-42fe-ab8b-4691f15734e0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:09.299077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d374-5540-42fe-ab8b-4691f15734e0 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:09.300449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 666/1326] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jun 23 10:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:09.307275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fedc2-6026-480f-a826-4ca1a0159857 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:09.307643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fedc2-6026-480f-a826-4ca1a0159857 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:09.307993 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fedc2-6026-480f-a826-4ca1a0159857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:09.341303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:09.388800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-356fedc2-6026-480f-a826-4ca1a0159857 None None] MFA Rules not processed for user `ed8f21a950d6483abc7ab67fb533942a`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:09.389934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-356fedc2-6026-480f-a826-4ca1a0159857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:09.467951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 661/1327] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jun 23 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:09.477057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d374-5540-42fe-ab8b-4691f15734e0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:09.478623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2b78d374-5540-42fe-ab8b-4691f15734e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:09.596210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d374-5540-42fe-ab8b-4691f15734e0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:09.678520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9baee6-52a3-45cc-a13d-e77a1f409e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:09.679083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9baee6-52a3-45cc-a13d-e77a1f409e3a service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:09.679360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9baee6-52a3-45cc-a13d-e77a1f409e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:09.679660 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9baee6-52a3-45cc-a13d-e77a1f409e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:09.681303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-fc9baee6-52a3-45cc-a13d-e77a1f409e3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:09.699131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:09.809134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9baee6-52a3-45cc-a13d-e77a1f409e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:09.810601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9baee6-52a3-45cc-a13d-e77a1f409e3a service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:09.829931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 667/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:12.164607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc17d5-19fa-489b-b2a9-30501528cada None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:12.165121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc17d5-19fa-489b-b2a9-30501528cada None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:12.165121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc17d5-19fa-489b-b2a9-30501528cada None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:12.166532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 662/1329] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:12.172289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69cc9e-b370-4665-bca7-7d6caaaaad99 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:12.172799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69cc9e-b370-4665-bca7-7d6caaaaad99 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:12.172911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69cc9e-b370-4665-bca7-7d6caaaaad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:12.240272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-be69cc9e-b370-4665-bca7-7d6caaaaad99 None None] MFA Rules not processed for user `ec4709eda5dd45ea8a9d35bf7da1f22b`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:12.241487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-be69cc9e-b370-4665-bca7-7d6caaaaad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:12.304742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:12.336466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 668/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:12.375031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc17d5-19fa-489b-b2a9-30501528cada None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:12.376819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-aebc17d5-19fa-489b-b2a9-30501528cada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:12.495010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc17d5-19fa-489b-b2a9-30501528cada None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:12.515872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:12.572638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ca594-616a-47fa-912d-0234455497c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:12.573280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca594-616a-47fa-912d-0234455497c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:12.573560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca594-616a-47fa-912d-0234455497c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:12.573862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca594-616a-47fa-912d-0234455497c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:12.575583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ce9ca594-616a-47fa-912d-0234455497c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:12.688034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ca594-616a-47fa-912d-0234455497c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:12.689369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ca594-616a-47fa-912d-0234455497c5 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:12.709970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 663/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:15.063134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672942ae-3189-4cc0-b598-062dac604cdd None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:15.063647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672942ae-3189-4cc0-b598-062dac604cdd None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:15.063740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672942ae-3189-4cc0-b598-062dac604cdd None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:15.065114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 669/1332] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:15.070985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f662-39dd-474d-b5db-0044689ac50f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:15.071476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f662-39dd-474d-b5db-0044689ac50f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:15.071575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714f662-39dd-474d-b5db-0044689ac50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:15.138405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:15.141227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-9714f662-39dd-474d-b5db-0044689ac50f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:15.143014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9714f662-39dd-474d-b5db-0044689ac50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:15.243217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 664/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:15.279948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672942ae-3189-4cc0-b598-062dac604cdd None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:15.281547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-672942ae-3189-4cc0-b598-062dac604cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:15.384823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672942ae-3189-4cc0-b598-062dac604cdd None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:15.456075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72a1bd-2954-4f28-983d-8a0f81150240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:15.456715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72a1bd-2954-4f28-983d-8a0f81150240 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:15.456996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72a1bd-2954-4f28-983d-8a0f81150240 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:15.457273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72a1bd-2954-4f28-983d-8a0f81150240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:15.459484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4d72a1bd-2954-4f28-983d-8a0f81150240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:15.486039 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:15.568543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72a1bd-2954-4f28-983d-8a0f81150240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:15.569974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72a1bd-2954-4f28-983d-8a0f81150240 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:15.588354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 670/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:17.670299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4118ce-a7fe-4b81-b3b8-b710aa533625 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:17.670854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4118ce-a7fe-4b81-b3b8-b710aa533625 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:17.670854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4118ce-a7fe-4b81-b3b8-b710aa533625 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:17.672277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 665/1335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:17.678104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1f22-e0f1-4fbe-85a5-f639fdd93438 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:17.678555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1f22-e0f1-4fbe-85a5-f639fdd93438 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:17.678757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1f22-e0f1-4fbe-85a5-f639fdd93438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:17.746413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-97dc1f22-e0f1-4fbe-85a5-f639fdd93438 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:17.747638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-97dc1f22-e0f1-4fbe-85a5-f639fdd93438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:17.821734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:17.843719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 671/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:17.884206 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4118ce-a7fe-4b81-b3b8-b710aa533625 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:17.885740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9c4118ce-a7fe-4b81-b3b8-b710aa533625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:17.991378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4118ce-a7fe-4b81-b3b8-b710aa533625 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:18.019796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:18.065871 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3c3cf-f55f-42cb-8f05-9843866f31ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:18.066534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c3cf-f55f-42cb-8f05-9843866f31ca service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:18.066815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c3cf-f55f-42cb-8f05-9843866f31ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:18.067124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c3cf-f55f-42cb-8f05-9843866f31ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:18.069019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c2f3c3cf-f55f-42cb-8f05-9843866f31ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:18.176743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3c3cf-f55f-42cb-8f05-9843866f31ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:18.178095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3c3cf-f55f-42cb-8f05-9843866f31ca service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:18.196675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 666/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:20.571558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f04bb0-ff8b-4344-af94-dc3f9b4cf03f None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:20.572067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f04bb0-ff8b-4344-af94-dc3f9b4cf03f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:20.572164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f04bb0-ff8b-4344-af94-dc3f9b4cf03f None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:20.573498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 672/1338] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:20.578703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff72a1-94d5-44f6-942a-c80f3e1becfa None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:20.579090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff72a1-94d5-44f6-942a-c80f3e1becfa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:20.579265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff72a1-94d5-44f6-942a-c80f3e1becfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:20.644881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-bdff72a1-94d5-44f6-942a-c80f3e1becfa None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:20.646178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bdff72a1-94d5-44f6-942a-c80f3e1becfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:20.654902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:20.744844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 667/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:20.781872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f04bb0-ff8b-4344-af94-dc3f9b4cf03f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:20.783466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-86f04bb0-ff8b-4344-af94-dc3f9b4cf03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:20.887087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f04bb0-ff8b-4344-af94-dc3f9b4cf03f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:20.959573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de56ee-b702-4086-b186-7449c7673d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:20.960212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de56ee-b702-4086-b186-7449c7673d7f service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:20.960497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de56ee-b702-4086-b186-7449c7673d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:20.960776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de56ee-b702-4086-b186-7449c7673d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:20.962465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-75de56ee-b702-4086-b186-7449c7673d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:20.997553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:21.075073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de56ee-b702-4086-b186-7449c7673d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:21.076509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de56ee-b702-4086-b186-7449c7673d7f service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:21.095041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 673/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:25.220766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb1aaa-1a6c-446a-aea6-90cae845a45e None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:25.221389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb1aaa-1a6c-446a-aea6-90cae845a45e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:25.221389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb1aaa-1a6c-446a-aea6-90cae845a45e None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:25.223261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 668/1341] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:25.229421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dc31a-1eb8-4d7d-b557-7a04e20b22f0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:25.229421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dc31a-1eb8-4d7d-b557-7a04e20b22f0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:25.230011 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dc31a-1eb8-4d7d-b557-7a04e20b22f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:25.327448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-7b0dc31a-1eb8-4d7d-b557-7a04e20b22f0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:25.328582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7b0dc31a-1eb8-4d7d-b557-7a04e20b22f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:25.425512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:25.440153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 674/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:25.479707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb1aaa-1a6c-446a-aea6-90cae845a45e None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:25.481854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-afeb1aaa-1a6c-446a-aea6-90cae845a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:25.629356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb1aaa-1a6c-446a-aea6-90cae845a45e None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:25.633073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792db59-2bea-4409-b5f7-bdb4708817e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:25.633727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792db59-2bea-4409-b5f7-bdb4708817e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:25.634008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792db59-2bea-4409-b5f7-bdb4708817e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:25.634282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792db59-2bea-4409-b5f7-bdb4708817e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:25.643790 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792db59-2bea-4409-b5f7-bdb4708817e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:25.645401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792db59-2bea-4409-b5f7-bdb4708817e6 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:25.655763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 669/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:28.539950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de113b77-52a3-4053-b21a-7f24bd25ab7e None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:28.540514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de113b77-52a3-4053-b21a-7f24bd25ab7e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:28.540514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de113b77-52a3-4053-b21a-7f24bd25ab7e None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:28.541883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 675/1344] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:28.547193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e36462-14be-4fb6-8b30-14a28b8184ab None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:28.547635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e36462-14be-4fb6-8b30-14a28b8184ab None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:28.547755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e36462-14be-4fb6-8b30-14a28b8184ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:28.575760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c6e36462-14be-4fb6-8b30-14a28b8184ab None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:28.576969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c6e36462-14be-4fb6-8b30-14a28b8184ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:28.611021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:28.676491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 670/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:28.716617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de113b77-52a3-4053-b21a-7f24bd25ab7e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:28.727864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de113b77-52a3-4053-b21a-7f24bd25ab7e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:28.731454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ed82e-c8c5-480e-a8c2-42516376c47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:28.732112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ed82e-c8c5-480e-a8c2-42516376c47e service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:28.732397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ed82e-c8c5-480e-a8c2-42516376c47e service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:28.732670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ed82e-c8c5-480e-a8c2-42516376c47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:28.742826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ed82e-c8c5-480e-a8c2-42516376c47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:28.744295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ed82e-c8c5-480e-a8c2-42516376c47e service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:28.755675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 676/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:32.910190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e89f75-aa38-4c43-b9b5-cd891f3f4c82 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:32.911504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e89f75-aa38-4c43-b9b5-cd891f3f4c82 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:32.911504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e89f75-aa38-4c43-b9b5-cd891f3f4c82 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:32.913186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 671/1347] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:32.918744 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daef06-b4cd-42d8-91f7-d32236f9473e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:32.919230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daef06-b4cd-42d8-91f7-d32236f9473e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:32.919454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daef06-b4cd-42d8-91f7-d32236f9473e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:32.937757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-b8daef06-b4cd-42d8-91f7-d32236f9473e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:32.939262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b8daef06-b4cd-42d8-91f7-d32236f9473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:32.948357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 677/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:32.986735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e89f75-aa38-4c43-b9b5-cd891f3f4c82 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:32.997864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e89f75-aa38-4c43-b9b5-cd891f3f4c82 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:33.001636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ede34-82ab-493d-8ba7-d38f7a5d680b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:33.002292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ede34-82ab-493d-8ba7-d38f7a5d680b service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:33.002610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ede34-82ab-493d-8ba7-d38f7a5d680b service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:33.002891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ede34-82ab-493d-8ba7-d38f7a5d680b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:33.012374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ede34-82ab-493d-8ba7-d38f7a5d680b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:33.013812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ede34-82ab-493d-8ba7-d38f7a5d680b service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:33.024365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 672/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:38.190078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e07ee-a478-4857-8578-b29c842a9416 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:38.191343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e07ee-a478-4857-8578-b29c842a9416 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:38.192463 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e07ee-a478-4857-8578-b29c842a9416 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:38.194401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 678/1350] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:42:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:38.199846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720edc35-cb9f-4445-9eab-cd871583e89c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:38.200317 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720edc35-cb9f-4445-9eab-cd871583e89c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:38.200594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720edc35-cb9f-4445-9eab-cd871583e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:38.302247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-720edc35-cb9f-4445-9eab-cd871583e89c None None] MFA Rules not processed for user `64ce422f60d64b368df8be61e1065282`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:38.303933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-720edc35-cb9f-4445-9eab-cd871583e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:38.397640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 673/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:42.933485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=13 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:42.963794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de480-4f83-4cd4-be26-d8d8a959964d None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:42.963794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de480-4f83-4cd4-be26-d8d8a959964d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:42.964310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de480-4f83-4cd4-be26-d8d8a959964d None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:42.965717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 679/1352] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:42.973702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a9cb9-9f71-4bb3-84d3-911074ace96a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:42.974683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a9cb9-9f71-4bb3-84d3-911074ace96a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:42.975250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a9cb9-9f71-4bb3-84d3-911074ace96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:42.994867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-491a9cb9-9f71-4bb3-84d3-911074ace96a None None] MFA Rules not processed for user `64ce422f60d64b368df8be61e1065282`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:42.996081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-491a9cb9-9f71-4bb3-84d3-911074ace96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:43.006174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 674/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:44.677274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08c035-2269-4f41-a41c-4db17446b419 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:44.677825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08c035-2269-4f41-a41c-4db17446b419 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:44.678012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08c035-2269-4f41-a41c-4db17446b419 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:44.679527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 680/1354] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:44.684815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbc787-1fad-413c-ad00-66500bcac20f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:44.685241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbc787-1fad-413c-ad00-66500bcac20f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:44.685446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbc787-1fad-413c-ad00-66500bcac20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:44.705409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7adbc787-1fad-413c-ad00-66500bcac20f None None] MFA Rules not processed for user `64ce422f60d64b368df8be61e1065282`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:44.706650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7adbc787-1fad-413c-ad00-66500bcac20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:44.716203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 675/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:42:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:42:48.510103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d4a9d-3b80-4300-b0f9-7a9e687372cb None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:48.510641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d4a9d-3b80-4300-b0f9-7a9e687372cb None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:48.510641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d4a9d-3b80-4300-b0f9-7a9e687372cb None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:48.512725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 681/1356] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:48.520537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396558c4-9870-4ffd-b8de-e226d6d0148e None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:48.521094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396558c4-9870-4ffd-b8de-e226d6d0148e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:48.521388 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396558c4-9870-4ffd-b8de-e226d6d0148e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:48.550199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-396558c4-9870-4ffd-b8de-e226d6d0148e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:48.552018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-396558c4-9870-4ffd-b8de-e226d6d0148e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:48.561173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 676/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:48.637640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0d14b-815a-43d4-b262-b2e6ac25c403 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:48.638493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0d14b-815a-43d4-b262-b2e6ac25c403 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:48.639175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0d14b-815a-43d4-b262-b2e6ac25c403 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:48.640733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 682/1358] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 23 10:42:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:48.653615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c94f7-3e97-402b-8075-3dd32f82a6ce None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:48.653994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c94f7-3e97-402b-8075-3dd32f82a6ce None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:48.654359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c94f7-3e97-402b-8075-3dd32f82a6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:48.708189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:48.718956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b66c94f7-3e97-402b-8075-3dd32f82a6ce None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:48.720284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b66c94f7-3e97-402b-8075-3dd32f82a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:48.809543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 677/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 23 10:42:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:42:48.818057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0d14b-815a-43d4-b262-b2e6ac25c403 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:48.834255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0d14b-815a-43d4-b262-b2e6ac25c403 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:48.840286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b551a-4b39-49cc-bb73-b269826b2b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:48.840932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b551a-4b39-49cc-bb73-b269826b2b42 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:48.841217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b551a-4b39-49cc-bb73-b269826b2b42 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:48.841711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b551a-4b39-49cc-bb73-b269826b2b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:48.851899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b551a-4b39-49cc-bb73-b269826b2b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:48.854651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b551a-4b39-49cc-bb73-b269826b2b42 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:48.869370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 683/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:51.152689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e240ce-53b0-433f-b51d-238c2823e997 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:51.153240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e240ce-53b0-433f-b51d-238c2823e997 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:51.153240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e240ce-53b0-433f-b51d-238c2823e997 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:51.154858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 678/1361] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:51.159900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d415823-2a1d-4a80-8dfa-65f4e3536aea None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:51.160938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d415823-2a1d-4a80-8dfa-65f4e3536aea None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:51.161114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d415823-2a1d-4a80-8dfa-65f4e3536aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:51.179262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2d415823-2a1d-4a80-8dfa-65f4e3536aea None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:51.180475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2d415823-2a1d-4a80-8dfa-65f4e3536aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:51.188250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 684/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:51.234814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e240ce-53b0-433f-b51d-238c2823e997 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:51.251125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e240ce-53b0-433f-b51d-238c2823e997 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:51.257455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cedd6-7892-423d-b464-0c4fe61c9e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:51.258235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cedd6-7892-423d-b464-0c4fe61c9e21 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:51.258653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cedd6-7892-423d-b464-0c4fe61c9e21 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:51.259037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cedd6-7892-423d-b464-0c4fe61c9e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:51.268058 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cedd6-7892-423d-b464-0c4fe61c9e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:51.270333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cedd6-7892-423d-b464-0c4fe61c9e21 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:51.282772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 679/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:53.802829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac94b-7543-46bc-b37a-0801740e7cc5 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:53.803387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac94b-7543-46bc-b37a-0801740e7cc5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:53.803387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fac94b-7543-46bc-b37a-0801740e7cc5 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:53.804663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 685/1364] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:53.810030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20e56a-cbe2-49b2-8f4b-cc4f9f088ac7 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:53.810507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20e56a-cbe2-49b2-8f4b-cc4f9f088ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:53.810636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20e56a-cbe2-49b2-8f4b-cc4f9f088ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:53.830194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7b20e56a-cbe2-49b2-8f4b-cc4f9f088ac7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:53.831791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7b20e56a-cbe2-49b2-8f4b-cc4f9f088ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:53.840944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 680/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:53.888923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d2c09-1934-43df-a30a-7c1ac17541a8 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:53.889298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d2c09-1934-43df-a30a-7c1ac17541a8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:53.889586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d2c09-1934-43df-a30a-7c1ac17541a8 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:53.891273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 686/1366] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 23 10:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:53.899458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6b59-5752-4451-87ec-07bbdc555cad None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:53.899682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6b59-5752-4451-87ec-07bbdc555cad None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:53.900285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6b59-5752-4451-87ec-07bbdc555cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:53.928083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f56d6b59-5752-4451-87ec-07bbdc555cad None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:53.930764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f56d6b59-5752-4451-87ec-07bbdc555cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:53.955125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 681/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 23 10:42:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:53.963988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d2c09-1934-43df-a30a-7c1ac17541a8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:53.983075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d2c09-1934-43df-a30a-7c1ac17541a8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:53.989057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e47ed0-6765-4062-9dd5-5b1095bd9023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:53.989902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e47ed0-6765-4062-9dd5-5b1095bd9023 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:53.990196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e47ed0-6765-4062-9dd5-5b1095bd9023 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:53.990519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e47ed0-6765-4062-9dd5-5b1095bd9023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:53.999624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e47ed0-6765-4062-9dd5-5b1095bd9023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:54.001331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e47ed0-6765-4062-9dd5-5b1095bd9023 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:54.012030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 687/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:56.230129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f523-17da-4d8a-99fb-79c0f1219ec9 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:56.230700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f523-17da-4d8a-99fb-79c0f1219ec9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:56.230814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f523-17da-4d8a-99fb-79c0f1219ec9 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:56.232509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 682/1369] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:56.238139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960824dd-0cf1-4946-bc34-cb1e0381bab5 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:56.239135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960824dd-0cf1-4946-bc34-cb1e0381bab5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:56.239677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960824dd-0cf1-4946-bc34-cb1e0381bab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:56.260759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-960824dd-0cf1-4946-bc34-cb1e0381bab5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:56.262000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-960824dd-0cf1-4946-bc34-cb1e0381bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:56.271618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 688/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:42:56.323378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f523-17da-4d8a-99fb-79c0f1219ec9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:56.343193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f523-17da-4d8a-99fb-79c0f1219ec9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:56.349748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf759d5-0c9b-4c15-a4be-44df427d47ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:56.350462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf759d5-0c9b-4c15-a4be-44df427d47ef service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:56.350749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf759d5-0c9b-4c15-a4be-44df427d47ef service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:56.351028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf759d5-0c9b-4c15-a4be-44df427d47ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:56.360715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf759d5-0c9b-4c15-a4be-44df427d47ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:56.362345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf759d5-0c9b-4c15-a4be-44df427d47ef service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:56.373869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 683/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:56.847724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0ea7a-80a9-433d-90f9-817d3690f115 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:56.848299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0ea7a-80a9-433d-90f9-817d3690f115 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:56.848844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0ea7a-80a9-433d-90f9-817d3690f115 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:56.856357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa376e-4239-4d83-b06e-c6e7a39354bf None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:56.857012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa376e-4239-4d83-b06e-c6e7a39354bf None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:56.857531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa376e-4239-4d83-b06e-c6e7a39354bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:56.859804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 689/1372] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:56 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:56.888916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a7aa376e-4239-4d83-b06e-c6e7a39354bf None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:56.890156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a7aa376e-4239-4d83-b06e-c6e7a39354bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:56.898963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 684/1373] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:57.260635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940d29-4500-4ffd-aa57-001e92e84b8a None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:57.261122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940d29-4500-4ffd-aa57-001e92e84b8a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:57.261207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940d29-4500-4ffd-aa57-001e92e84b8a None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:57.262590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 690/1374] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jun 23 10:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:57.267929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b9059-d416-4565-b5d6-99c2e6f729a0 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:57.268390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b9059-d416-4565-b5d6-99c2e6f729a0 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:57.268538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b9059-d416-4565-b5d6-99c2e6f729a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:57.326832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-e20b9059-d416-4565-b5d6-99c2e6f729a0 None None] MFA Rules not processed for user `0930d783a2574d5caeb2587fe4157cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:57.328063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e20b9059-d416-4565-b5d6-99c2e6f729a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:57.410616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 685/1375] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jun 23 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:57.418365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940d29-4500-4ffd-aa57-001e92e84b8a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:57.430276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940d29-4500-4ffd-aa57-001e92e84b8a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:57.433794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5ac0c-419a-4174-b228-f5851e2fcb40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:57.434472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5ac0c-419a-4174-b228-f5851e2fcb40 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:57.434758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5ac0c-419a-4174-b228-f5851e2fcb40 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:57.435031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5ac0c-419a-4174-b228-f5851e2fcb40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:57.445550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5ac0c-419a-4174-b228-f5851e2fcb40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:57.447038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5ac0c-419a-4174-b228-f5851e2fcb40 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:57.462459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 691/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:42:58.741978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675f26-d63b-4ee2-8492-5f7d4e7890b3 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:58.742547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675f26-d63b-4ee2-8492-5f7d4e7890b3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:58.742547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675f26-d63b-4ee2-8492-5f7d4e7890b3 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:58.743950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 686/1377] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:42:58.749151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ca754-d7f4-47ce-b598-e064d2197fe8 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:58.749575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ca754-d7f4-47ce-b598-e064d2197fe8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:58.749711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ca754-d7f4-47ce-b598-e064d2197fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:58.769013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-453ca754-d7f4-47ce-b598-e064d2197fe8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:42:58.770951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-453ca754-d7f4-47ce-b598-e064d2197fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:42:58.778779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 692/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:42:58.823212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675f26-d63b-4ee2-8492-5f7d4e7890b3 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:42:58.838557 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675f26-d63b-4ee2-8492-5f7d4e7890b3 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:42:58.844124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45a3bb-181d-4e41-bd15-513199c84efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:42:58.844771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a3bb-181d-4e41-bd15-513199c84efc service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:42:58.845054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a3bb-181d-4e41-bd15-513199c84efc service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:42:58.845332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a3bb-181d-4e41-bd15-513199c84efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:42:58.855989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a3bb-181d-4e41-bd15-513199c84efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:42:58.857576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a3bb-181d-4e41-bd15-513199c84efc service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:42:58.861675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:42:58.869956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 687/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:00.995739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c39a9-2fbd-48d6-9d68-a260778f44dd None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:00.996569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c39a9-2fbd-48d6-9d68-a260778f44dd None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:00.997044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c39a9-2fbd-48d6-9d68-a260778f44dd None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:00.998861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 693/1380] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:01.004793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c42145-44c2-4b99-a2d7-5b6103b0ea20 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:01.005284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c42145-44c2-4b99-a2d7-5b6103b0ea20 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:01.005380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c42145-44c2-4b99-a2d7-5b6103b0ea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:01.036913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a7c42145-44c2-4b99-a2d7-5b6103b0ea20 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:01.039065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a7c42145-44c2-4b99-a2d7-5b6103b0ea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:01.047375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 688/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:01.099338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c39a9-2fbd-48d6-9d68-a260778f44dd None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:01.122665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c39a9-2fbd-48d6-9d68-a260778f44dd None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:01.134935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddf684-2988-422d-996b-a33065820492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:01.137748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddf684-2988-422d-996b-a33065820492 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:01.138266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddf684-2988-422d-996b-a33065820492 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:01.138820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddf684-2988-422d-996b-a33065820492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:01.152888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddf684-2988-422d-996b-a33065820492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:01.154690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddf684-2988-422d-996b-a33065820492 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:01.169261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 694/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:03.320945 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f72886-379f-4df5-a893-78f20b29eb26 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:03.321492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f72886-379f-4df5-a893-78f20b29eb26 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:03.321492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f72886-379f-4df5-a893-78f20b29eb26 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:03.322885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 689/1383] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:03.328479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d8a1-fdb7-4519-a53e-3747e84e0265 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:03.329002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d8a1-fdb7-4519-a53e-3747e84e0265 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:03.329292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d8a1-fdb7-4519-a53e-3747e84e0265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:03.348710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-09d4d8a1-fdb7-4519-a53e-3747e84e0265 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:03.349985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-09d4d8a1-fdb7-4519-a53e-3747e84e0265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:03.358051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 695/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:03.403624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f72886-379f-4df5-a893-78f20b29eb26 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:03.419120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f72886-379f-4df5-a893-78f20b29eb26 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:03.424926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05dfea-9c88-495d-a893-01c29163dc3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:03.425614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05dfea-9c88-495d-a893-01c29163dc3c service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:03.426441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05dfea-9c88-495d-a893-01c29163dc3c service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:03.426733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05dfea-9c88-495d-a893-01c29163dc3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:03.436590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05dfea-9c88-495d-a893-01c29163dc3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:03.438306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05dfea-9c88-495d-a893-01c29163dc3c service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:03.450093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 690/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:05.660090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4331a-1543-4241-8265-f4248b7d9c77 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:05.660768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4331a-1543-4241-8265-f4248b7d9c77 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:05.660768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4331a-1543-4241-8265-f4248b7d9c77 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:05.662067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 696/1386] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:05.669299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a4f76-d81f-4e4a-b6c2-48ef3c4e84d3 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:05.669898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a4f76-d81f-4e4a-b6c2-48ef3c4e84d3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:05.670021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a4f76-d81f-4e4a-b6c2-48ef3c4e84d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:05.689400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ff9a4f76-d81f-4e4a-b6c2-48ef3c4e84d3 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:05.690687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ff9a4f76-d81f-4e4a-b6c2-48ef3c4e84d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:05.699841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 691/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:05.757338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4331a-1543-4241-8265-f4248b7d9c77 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:05.773874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4331a-1543-4241-8265-f4248b7d9c77 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:05.780374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d347f-3585-46b9-95b3-26fcb230166a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:05.781037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d347f-3585-46b9-95b3-26fcb230166a service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:05.781320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d347f-3585-46b9-95b3-26fcb230166a service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:05.781601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d347f-3585-46b9-95b3-26fcb230166a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:05.791865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d347f-3585-46b9-95b3-26fcb230166a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:05.793433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d347f-3585-46b9-95b3-26fcb230166a service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:05.805237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 697/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:07.947558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1131-963a-4375-86f1-7fc4e0b3f9be None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:07.948277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1131-963a-4375-86f1-7fc4e0b3f9be None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:07.948277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d1131-963a-4375-86f1-7fc4e0b3f9be None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:07.949516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 692/1389] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:07.955238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941788e1-99c4-42a3-9ac7-452027f1bccb None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:07.955807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941788e1-99c4-42a3-9ac7-452027f1bccb None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:07.955807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941788e1-99c4-42a3-9ac7-452027f1bccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:07.974851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-941788e1-99c4-42a3-9ac7-452027f1bccb None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:07.978012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-941788e1-99c4-42a3-9ac7-452027f1bccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:07.989355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 698/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:43:08.037572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d1131-963a-4375-86f1-7fc4e0b3f9be None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:08.057163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d1131-963a-4375-86f1-7fc4e0b3f9be None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:08.062741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc5ac-b501-4532-b169-864c54ca49a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:08.063393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc5ac-b501-4532-b169-864c54ca49a0 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:08.063674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc5ac-b501-4532-b169-864c54ca49a0 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:08.063950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc5ac-b501-4532-b169-864c54ca49a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:08.073869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc5ac-b501-4532-b169-864c54ca49a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:08.075519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc5ac-b501-4532-b169-864c54ca49a0 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:08.086144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 693/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:10.199117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4eeef-4eb0-42c5-8e3a-6b516b852013 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:10.199653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4eeef-4eb0-42c5-8e3a-6b516b852013 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:10.199773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4eeef-4eb0-42c5-8e3a-6b516b852013 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:10.201117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 699/1392] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:10.207175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a91e7-6c8b-4853-8275-0d150adb788e None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:10.207650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a91e7-6c8b-4853-8275-0d150adb788e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:10.207976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a91e7-6c8b-4853-8275-0d150adb788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:10.226638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-347a91e7-6c8b-4853-8275-0d150adb788e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:10.227860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-347a91e7-6c8b-4853-8275-0d150adb788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:10.235680 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 694/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:10.287706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4eeef-4eb0-42c5-8e3a-6b516b852013 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:10.307141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4eeef-4eb0-42c5-8e3a-6b516b852013 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:10.314239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623df9ab-f522-42b9-9d17-325ea2784d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:10.315400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623df9ab-f522-42b9-9d17-325ea2784d1c service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:10.315768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623df9ab-f522-42b9-9d17-325ea2784d1c service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:10.317292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623df9ab-f522-42b9-9d17-325ea2784d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:10.332952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623df9ab-f522-42b9-9d17-325ea2784d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:10.335278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623df9ab-f522-42b9-9d17-325ea2784d1c service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:10.349784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 700/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:12.471018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd55a-2b3f-449a-8306-4e9683f8bf6e None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.471018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd55a-2b3f-449a-8306-4e9683f8bf6e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.471018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd55a-2b3f-449a-8306-4e9683f8bf6e None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:12.471018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 695/1395] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:12.478786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c477bc-642e-4644-910c-3eb5f6b1def0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.479277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c477bc-642e-4644-910c-3eb5f6b1def0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.479373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c477bc-642e-4644-910c-3eb5f6b1def0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:12.498171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-86c477bc-642e-4644-910c-3eb5f6b1def0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:12.499413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-86c477bc-642e-4644-910c-3eb5f6b1def0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:12.508168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 701/1396] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:43:12.553818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dd55a-2b3f-449a-8306-4e9683f8bf6e None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:12.569150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dd55a-2b3f-449a-8306-4e9683f8bf6e None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:12.580990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee93d0-b301-496e-8644-c8afca86a182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:12.581853 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee93d0-b301-496e-8644-c8afca86a182 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.582898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee93d0-b301-496e-8644-c8afca86a182 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.583212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee93d0-b301-496e-8644-c8afca86a182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:12.592220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee93d0-b301-496e-8644-c8afca86a182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:12.593806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee93d0-b301-496e-8644-c8afca86a182 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:12.604571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 696/1397] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:12.991623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac056c9-d29b-4d21-9ab6-9e21b8a5015b None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.992033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac056c9-d29b-4d21-9ab6-9e21b8a5015b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.992345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac056c9-d29b-4d21-9ab6-9e21b8a5015b None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:12.993711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 702/1398] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:12.999119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da6587-684d-4dbf-954b-fef5ce77d07b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:12.999413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da6587-684d-4dbf-954b-fef5ce77d07b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:12.999697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da6587-684d-4dbf-954b-fef5ce77d07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:13.018677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-67da6587-684d-4dbf-954b-fef5ce77d07b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:13.020015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-67da6587-684d-4dbf-954b-fef5ce77d07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:13.027995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 697/1399] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:13.085194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dee828-aa35-476c-b966-b0afbeff356e None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:13.085671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dee828-aa35-476c-b966-b0afbeff356e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:13.086015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dee828-aa35-476c-b966-b0afbeff356e None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:13.087486 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 703/1400] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jun 23 10:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:13.092585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34782aa-7157-4d7d-ba3d-848af80700fd None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:13.092881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34782aa-7157-4d7d-ba3d-848af80700fd None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:13.093166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34782aa-7157-4d7d-ba3d-848af80700fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:13.145619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f34782aa-7157-4d7d-ba3d-848af80700fd None None] MFA Rules not processed for user `33a1696d1cc14ca6ac1cb970598f11fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:13.147063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f34782aa-7157-4d7d-ba3d-848af80700fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:13.209595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 698/1401] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jun 23 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:13.217331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dee828-aa35-476c-b966-b0afbeff356e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:13.223615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=55 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:13.229882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dee828-aa35-476c-b966-b0afbeff356e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:13.233395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d4898-6c9c-409b-bca5-c7d0ecd4fa77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a1696d1cc14ca6ac1cb970598f11fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:13.234034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d4898-6c9c-409b-bca5-c7d0ecd4fa77 service glance] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:13.234332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d4898-6c9c-409b-bca5-c7d0ecd4fa77 service glance] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:13.234650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d4898-6c9c-409b-bca5-c7d0ecd4fa77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:13.244239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d4898-6c9c-409b-bca5-c7d0ecd4fa77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:13.245663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d4898-6c9c-409b-bca5-c7d0ecd4fa77 service glance] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:13.256530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 704/1402] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:13.986616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0873c3b-7213-412f-a96f-8cd2b8900436 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:13.987085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0873c3b-7213-412f-a96f-8cd2b8900436 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:13.987322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0873c3b-7213-412f-a96f-8cd2b8900436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:14.037185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a0873c3b-7213-412f-a96f-8cd2b8900436 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:14.038434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a0873c3b-7213-412f-a96f-8cd2b8900436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:14.080752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:14.105835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 699/1403] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:14.148410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb654a9-cc00-4563-88ea-5737de33be63 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:14.148912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb654a9-cc00-4563-88ea-5737de33be63 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:14.149025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb654a9-cc00-4563-88ea-5737de33be63 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:14.150395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 705/1404] 10.222.0.39 () {54 vars in 942 bytes} [Thu Jun 23 10:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:14.157173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1976dcf-ae79-48ba-943b-6c09b1f7eb22 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:14.157463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1976dcf-ae79-48ba-943b-6c09b1f7eb22 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:14.158002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1976dcf-ae79-48ba-943b-6c09b1f7eb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:14.208971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d1976dcf-ae79-48ba-943b-6c09b1f7eb22 None None] MFA Rules not processed for user `cbf19adc48f0439b9cdcb1aaedd58a01`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:14.210189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d1976dcf-ae79-48ba-943b-6c09b1f7eb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:14.285687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 700/1405] 10.222.0.39 () {58 vars in 1039 bytes} [Thu Jun 23 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:14.294914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb654a9-cc00-4563-88ea-5737de33be63 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:14.308540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb654a9-cc00-4563-88ea-5737de33be63 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:14.313542 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada31ce5-523a-4c8d-b438-ab068b01c60e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:14.314182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada31ce5-523a-4c8d-b438-ab068b01c60e service swift] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:14.314502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada31ce5-523a-4c8d-b438-ab068b01c60e service swift] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:14.314785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada31ce5-523a-4c8d-b438-ab068b01c60e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:14.324509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada31ce5-523a-4c8d-b438-ab068b01c60e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:14.326105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada31ce5-523a-4c8d-b438-ab068b01c60e service swift] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:14.338027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 706/1406] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:43:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:43:14.824076 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45c28-595c-4260-bab8-5838aed539ab None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:14.824373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45c28-595c-4260-bab8-5838aed539ab None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:14.824741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d45c28-595c-4260-bab8-5838aed539ab None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:14.837044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 701/1407] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:43:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:14.839016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc7004-3270-4bb6-a558-cf746a147239 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:14.839318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc7004-3270-4bb6-a558-cf746a147239 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:14.839603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc7004-3270-4bb6-a558-cf746a147239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:14.863695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-84fc7004-3270-4bb6-a558-cf746a147239 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:14.865433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-84fc7004-3270-4bb6-a558-cf746a147239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:14.873799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 707/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:14.931918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45c28-595c-4260-bab8-5838aed539ab None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:14.959858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d45c28-595c-4260-bab8-5838aed539ab None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:14.965659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755aa43-5aeb-425e-8165-8ba527e33323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:14.966344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755aa43-5aeb-425e-8165-8ba527e33323 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:14.967345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755aa43-5aeb-425e-8165-8ba527e33323 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:14.967640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755aa43-5aeb-425e-8165-8ba527e33323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:14.990726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755aa43-5aeb-425e-8165-8ba527e33323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:14.992467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755aa43-5aeb-425e-8165-8ba527e33323 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:15.003414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 702/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:43:24.857953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=14 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:24.998852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=59 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:43:36.989952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7bac-d8ac-47f0-a3f1-6ce0fac8743b None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:36.990684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7bac-d8ac-47f0-a3f1-6ce0fac8743b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:36.990886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7bac-d8ac-47f0-a3f1-6ce0fac8743b None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:36.992487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 708/1410] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jun 23 10:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:36.997309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e394d-9fb3-45ad-a7e0-cc39626d8fba None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:36.997746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e394d-9fb3-45ad-a7e0-cc39626d8fba None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:36.997879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e394d-9fb3-45ad-a7e0-cc39626d8fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:37.015978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-059e394d-9fb3-45ad-a7e0-cc39626d8fba None None] MFA Rules not processed for user `64ce422f60d64b368df8be61e1065282`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:37.017188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-059e394d-9fb3-45ad-a7e0-cc39626d8fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:37.027178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 703/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 23 10:43:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:37.042267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aefc26-9dd4-443d-b524-3c4895629f15 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:37.042594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aefc26-9dd4-443d-b524-3c4895629f15 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:37.042882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aefc26-9dd4-443d-b524-3c4895629f15 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:37.044257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 709/1412] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jun 23 10:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:37.048850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013788c-815e-4893-871c-22ccb548913e None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:37.049141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013788c-815e-4893-871c-22ccb548913e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:37.049428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013788c-815e-4893-871c-22ccb548913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:37.067569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c013788c-815e-4893-871c-22ccb548913e None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:37.069047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c013788c-815e-4893-871c-22ccb548913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:37.078123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 704/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jun 23 10:43:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:39.623451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d523-c975-46f9-840a-c64679fbdfd2 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:39.623968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d523-c975-46f9-840a-c64679fbdfd2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:39.623968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0d523-c975-46f9-840a-c64679fbdfd2 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:39.625282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:39.631422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a95f3-41f1-47e1-9b19-48f20dc840ed None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:39.631895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a95f3-41f1-47e1-9b19-48f20dc840ed None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:39.632019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a95f3-41f1-47e1-9b19-48f20dc840ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:39.656010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-013a95f3-41f1-47e1-9b19-48f20dc840ed None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:39.657223 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-013a95f3-41f1-47e1-9b19-48f20dc840ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:39.665284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:39.710522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0d523-c975-46f9-840a-c64679fbdfd2 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:39.726730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0d523-c975-46f9-840a-c64679fbdfd2 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:39.732262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b13da-c625-442e-b5ac-f630c3c1c2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:39.732909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b13da-c625-442e-b5ac-f630c3c1c2dc service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:39.733195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b13da-c625-442e-b5ac-f630c3c1c2dc service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:39.733477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b13da-c625-442e-b5ac-f630c3c1c2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:39.742928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b13da-c625-442e-b5ac-f630c3c1c2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:39.744531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b13da-c625-442e-b5ac-f630c3c1c2dc service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:39.754588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 711/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:40.692874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af19ef-c9c7-4de7-a899-d4948618ff92 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:40.693441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af19ef-c9c7-4de7-a899-d4948618ff92 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:40.693821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af19ef-c9c7-4de7-a899-d4948618ff92 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:40.695981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:43:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:43:40.701540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5c664-5588-4084-bf9c-4a09974c41bc None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:40.702043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5c664-5588-4084-bf9c-4a09974c41bc None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:40.702140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5c664-5588-4084-bf9c-4a09974c41bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:40.725830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-7bf5c664-5588-4084-bf9c-4a09974c41bc None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:40.727176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7bf5c664-5588-4084-bf9c-4a09974c41bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:40.735044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:40.891797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af19ef-c9c7-4de7-a899-d4948618ff92 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:40.906749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af19ef-c9c7-4de7-a899-d4948618ff92 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:40.912578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7e379-7458-4a12-8464-b57447be05cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:40.913229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7e379-7458-4a12-8464-b57447be05cf service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:40.913516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7e379-7458-4a12-8464-b57447be05cf service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:40.913802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7e379-7458-4a12-8464-b57447be05cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:40.922528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7e379-7458-4a12-8464-b57447be05cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:40.924143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7e379-7458-4a12-8464-b57447be05cf service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:40.934709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 707/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:41.842544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c588410-cf8a-496e-943c-ded74b0c2884 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:41.843166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c588410-cf8a-496e-943c-ded74b0c2884 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:41.843166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c588410-cf8a-496e-943c-ded74b0c2884 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:41.844492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:41.850226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e78f5c-65bd-4895-8b7f-3671507c2b1c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:41.850758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e78f5c-65bd-4895-8b7f-3671507c2b1c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:41.850849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e78f5c-65bd-4895-8b7f-3671507c2b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:41.871402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-79e78f5c-65bd-4895-8b7f-3671507c2b1c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:41.872688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-79e78f5c-65bd-4895-8b7f-3671507c2b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:41.882850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:42.038008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c588410-cf8a-496e-943c-ded74b0c2884 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:42.055137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c588410-cf8a-496e-943c-ded74b0c2884 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:42.060563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09717417-75cc-4faa-9197-0cf4bff7c3e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:42.061245 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717417-75cc-4faa-9197-0cf4bff7c3e2 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:42.061530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717417-75cc-4faa-9197-0cf4bff7c3e2 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:42.061808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09717417-75cc-4faa-9197-0cf4bff7c3e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:42.071127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09717417-75cc-4faa-9197-0cf4bff7c3e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:42.072729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09717417-75cc-4faa-9197-0cf4bff7c3e2 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:42.082768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 714/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:43.002366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553831-0484-453c-9e87-a4cf6ad38f5a None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:43.003569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553831-0484-453c-9e87-a4cf6ad38f5a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:43.003569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0553831-0484-453c-9e87-a4cf6ad38f5a None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:43.005018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:43.010301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074b0b-4e24-44bd-8179-bdf8562db440 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:43.010779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074b0b-4e24-44bd-8179-bdf8562db440 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:43.010878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074b0b-4e24-44bd-8179-bdf8562db440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:43.030040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a6074b0b-4e24-44bd-8179-bdf8562db440 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:43.031323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a6074b0b-4e24-44bd-8179-bdf8562db440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:43.042900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:43.194944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0553831-0484-453c-9e87-a4cf6ad38f5a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:43.214124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0553831-0484-453c-9e87-a4cf6ad38f5a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:43.219943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c76d3-db70-4a09-9617-6622acb83020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:43.220583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c76d3-db70-4a09-9617-6622acb83020 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:43.220863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c76d3-db70-4a09-9617-6622acb83020 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:43.221139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c76d3-db70-4a09-9617-6622acb83020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:43.230765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c76d3-db70-4a09-9617-6622acb83020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:43.232963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c76d3-db70-4a09-9617-6622acb83020 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:43.243715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 710/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:43:44.136942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34407954-a222-4fd8-9e06-4186d627fae9 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:44.137529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34407954-a222-4fd8-9e06-4186d627fae9 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:44.137529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34407954-a222-4fd8-9e06-4186d627fae9 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:44.138908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:44.144566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd1d7-8729-41ba-ba09-bac7e2c913fa None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:44.145089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd1d7-8729-41ba-ba09-bac7e2c913fa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:44.145566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dd1d7-8729-41ba-ba09-bac7e2c913fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:44.164950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-401dd1d7-8729-41ba-ba09-bac7e2c913fa None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:44.166171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-401dd1d7-8729-41ba-ba09-bac7e2c913fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:44.176323 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:44.326525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34407954-a222-4fd8-9e06-4186d627fae9 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:44.340954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34407954-a222-4fd8-9e06-4186d627fae9 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:44.346266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01584c-6b99-4e16-a678-cb533b8cb455 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:44.347468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01584c-6b99-4e16-a678-cb533b8cb455 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:44.347750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01584c-6b99-4e16-a678-cb533b8cb455 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:44.348025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01584c-6b99-4e16-a678-cb533b8cb455 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:44.356806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01584c-6b99-4e16-a678-cb533b8cb455 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:44.358414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01584c-6b99-4e16-a678-cb533b8cb455 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:44.369378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 717/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:45.216663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9786a4c-6fff-4123-81a2-061c90260777 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:45.217234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9786a4c-6fff-4123-81a2-061c90260777 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:45.217234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9786a4c-6fff-4123-81a2-061c90260777 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:45.218642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:45.224523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d6ac-d168-4883-9cde-af9d5dc250a1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:45.225011 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d6ac-d168-4883-9cde-af9d5dc250a1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:45.225104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d6ac-d168-4883-9cde-af9d5dc250a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:45.243747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-31f5d6ac-d168-4883-9cde-af9d5dc250a1 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:45.244860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-31f5d6ac-d168-4883-9cde-af9d5dc250a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:45.253133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:45.411753 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9786a4c-6fff-4123-81a2-061c90260777 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:45.427152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9786a4c-6fff-4123-81a2-061c90260777 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:45.432669 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49533202-069d-4cd1-8178-80f78e7347d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:45.433319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49533202-069d-4cd1-8178-80f78e7347d0 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:45.433605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49533202-069d-4cd1-8178-80f78e7347d0 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:45.433883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49533202-069d-4cd1-8178-80f78e7347d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:45.443402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49533202-069d-4cd1-8178-80f78e7347d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:45.445364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49533202-069d-4cd1-8178-80f78e7347d0 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:45.455362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 713/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:46.287000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f69fe-af53-472b-a1b4-0c86887cd26a None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:46.287584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f69fe-af53-472b-a1b4-0c86887cd26a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:46.287584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f69fe-af53-472b-a1b4-0c86887cd26a None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:46.288917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:46.294283 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb274e-f11f-4f29-92d3-ef147ce45e19 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:46.294970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb274e-f11f-4f29-92d3-ef147ce45e19 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:46.294970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb274e-f11f-4f29-92d3-ef147ce45e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:46.314081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-5efb274e-f11f-4f29-92d3-ef147ce45e19 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:46.315525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5efb274e-f11f-4f29-92d3-ef147ce45e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:46.324133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:46.475337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f69fe-af53-472b-a1b4-0c86887cd26a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:46.491607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f69fe-af53-472b-a1b4-0c86887cd26a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:46.497069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179124b1-367f-4272-9afe-7e6b25bf0240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:46.497864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179124b1-367f-4272-9afe-7e6b25bf0240 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:46.498337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179124b1-367f-4272-9afe-7e6b25bf0240 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:46.498738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179124b1-367f-4272-9afe-7e6b25bf0240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:46.509004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179124b1-367f-4272-9afe-7e6b25bf0240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:46.510677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179124b1-367f-4272-9afe-7e6b25bf0240 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:46.521682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 720/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:47.342854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8e54b-a586-4154-b85d-1ed7b0ae5919 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:47.343690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8e54b-a586-4154-b85d-1ed7b0ae5919 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:47.343690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8e54b-a586-4154-b85d-1ed7b0ae5919 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:47.344803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:47.351991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6400aa0-8883-4a54-a8fb-76fa4fabc605 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:47.352696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6400aa0-8883-4a54-a8fb-76fa4fabc605 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:47.352871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6400aa0-8883-4a54-a8fb-76fa4fabc605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:47.375809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e6400aa0-8883-4a54-a8fb-76fa4fabc605 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:47.377031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e6400aa0-8883-4a54-a8fb-76fa4fabc605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:47.385650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:47.539330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8e54b-a586-4154-b85d-1ed7b0ae5919 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:47.555487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8e54b-a586-4154-b85d-1ed7b0ae5919 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:47.561118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865480e-d46d-4f54-89f7-cbeb88d695d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:47.561771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865480e-d46d-4f54-89f7-cbeb88d695d8 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:47.562057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865480e-d46d-4f54-89f7-cbeb88d695d8 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:47.562393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865480e-d46d-4f54-89f7-cbeb88d695d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:47.572576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865480e-d46d-4f54-89f7-cbeb88d695d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:47.574178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865480e-d46d-4f54-89f7-cbeb88d695d8 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:47.584881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 716/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:48.403693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61129-ae28-435f-89a5-6c86d393b7b0 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:48.404439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61129-ae28-435f-89a5-6c86d393b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:48.404439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61129-ae28-435f-89a5-6c86d393b7b0 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:48.405634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:48.413913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e737dd4-51b1-492d-9291-24c358012f11 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:48.413913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e737dd4-51b1-492d-9291-24c358012f11 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:48.413913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e737dd4-51b1-492d-9291-24c358012f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:48.433772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3e737dd4-51b1-492d-9291-24c358012f11 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:48.435985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3e737dd4-51b1-492d-9291-24c358012f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:48.445451 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:48.599689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc61129-ae28-435f-89a5-6c86d393b7b0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:48.616218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc61129-ae28-435f-89a5-6c86d393b7b0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:48.622779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051437a-2266-46be-bb3c-d46a1039eecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:48.623433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051437a-2266-46be-bb3c-d46a1039eecc service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:48.623717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051437a-2266-46be-bb3c-d46a1039eecc service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:48.623994 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051437a-2266-46be-bb3c-d46a1039eecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:48.632894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051437a-2266-46be-bb3c-d46a1039eecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:48.634528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051437a-2266-46be-bb3c-d46a1039eecc service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:48.644301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 723/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:50.656160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c092ea-b225-40ad-a012-698f433b7577 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:50.656706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c092ea-b225-40ad-a012-698f433b7577 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:50.656706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c092ea-b225-40ad-a012-698f433b7577 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:50.658412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:50.664154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341384-d7e0-485b-a60e-c0ab20c703db None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:50.664665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341384-d7e0-485b-a60e-c0ab20c703db None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:50.664772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee341384-d7e0-485b-a60e-c0ab20c703db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:50.683228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ee341384-d7e0-485b-a60e-c0ab20c703db None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:50.684438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ee341384-d7e0-485b-a60e-c0ab20c703db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:50.694991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:50.732642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c092ea-b225-40ad-a012-698f433b7577 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:50.734575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c0c092ea-b225-40ad-a012-698f433b7577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:50.748738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c092ea-b225-40ad-a012-698f433b7577 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:50.752265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ea13c-8a90-4f50-8027-413d640b132a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:50.753739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ea13c-8a90-4f50-8027-413d640b132a service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:50.754019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ea13c-8a90-4f50-8027-413d640b132a service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:50.754294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ea13c-8a90-4f50-8027-413d640b132a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:50.764111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ea13c-8a90-4f50-8027-413d640b132a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:50.765552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ea13c-8a90-4f50-8027-413d640b132a service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:50.775470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 719/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:53.377020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec9db-5ef6-4585-b7c9-a6ddde38a2ed None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:53.378199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec9db-5ef6-4585-b7c9-a6ddde38a2ed None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:53.378199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec9db-5ef6-4585-b7c9-a6ddde38a2ed None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:53.379546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:53.385091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcacfa3-5dc4-45af-b3be-1a635f47e283 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:53.385571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcacfa3-5dc4-45af-b3be-1a635f47e283 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:53.385702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcacfa3-5dc4-45af-b3be-1a635f47e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:53.407024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-6fcacfa3-5dc4-45af-b3be-1a635f47e283 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:53.408267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6fcacfa3-5dc4-45af-b3be-1a635f47e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:53.423380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:53.463363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effec9db-5ef6-4585-b7c9-a6ddde38a2ed None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:53.474550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effec9db-5ef6-4585-b7c9-a6ddde38a2ed None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:53.478044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fec68-ae28-456e-902f-0bd5953c67b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:53.478717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fec68-ae28-456e-902f-0bd5953c67b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:53.479003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fec68-ae28-456e-902f-0bd5953c67b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:53.479285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fec68-ae28-456e-902f-0bd5953c67b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:53.489284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fec68-ae28-456e-902f-0bd5953c67b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:53.490751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fec68-ae28-456e-902f-0bd5953c67b2 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:53.500822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 726/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:56.038904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e5a7-bf5e-4d87-937f-426ceb0d28e7 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:56.039496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e5a7-bf5e-4d87-937f-426ceb0d28e7 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:56.039496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7e5a7-bf5e-4d87-937f-426ceb0d28e7 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:56.040853 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:56.046787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c217-d6e9-42d0-9a25-7d99d071bc2b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:56.047275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c217-d6e9-42d0-9a25-7d99d071bc2b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:56.047407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7c217-d6e9-42d0-9a25-7d99d071bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:56.068263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e8f7c217-d6e9-42d0-9a25-7d99d071bc2b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:56.069911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e8f7c217-d6e9-42d0-9a25-7d99d071bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:56.078242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:56.118009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e5a7-bf5e-4d87-937f-426ceb0d28e7 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:56.129407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7e5a7-bf5e-4d87-937f-426ceb0d28e7 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:56.132959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c119050-092d-42a2-b79c-594abc32ff5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:56.133604 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c119050-092d-42a2-b79c-594abc32ff5e service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:56.133886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c119050-092d-42a2-b79c-594abc32ff5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:56.134166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c119050-092d-42a2-b79c-594abc32ff5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:56.144715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c119050-092d-42a2-b79c-594abc32ff5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:56.146163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c119050-092d-42a2-b79c-594abc32ff5e service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:56.165653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 722/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:43:58.557442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90667d-7fc4-4894-a530-97e4877c3872 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:58.558014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90667d-7fc4-4894-a530-97e4877c3872 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:58.558014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90667d-7fc4-4894-a530-97e4877c3872 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:58.559451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:43:58.565103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df96e7-e1e0-4010-8319-2097a9d4dd36 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:58.565565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df96e7-e1e0-4010-8319-2097a9d4dd36 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:58.565671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df96e7-e1e0-4010-8319-2097a9d4dd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:58.587698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-98df96e7-e1e0-4010-8319-2097a9d4dd36 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:43:58.589200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-98df96e7-e1e0-4010-8319-2097a9d4dd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:43:58.598186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:43:58.641683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90667d-7fc4-4894-a530-97e4877c3872 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:43:58.653483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90667d-7fc4-4894-a530-97e4877c3872 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:43:58.657111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daf38e-44fb-40c7-83b4-a0f3282aaeb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:43:58.657760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daf38e-44fb-40c7-83b4-a0f3282aaeb2 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:43:58.658048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daf38e-44fb-40c7-83b4-a0f3282aaeb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:43:58.658358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daf38e-44fb-40c7-83b4-a0f3282aaeb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:43:58.670616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daf38e-44fb-40c7-83b4-a0f3282aaeb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:43:58.672100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daf38e-44fb-40c7-83b4-a0f3282aaeb2 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:43:58.684273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 729/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:00.867756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3d2bf-d1b9-49c0-87a3-b7f15ff522b4 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:00.868433 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3d2bf-d1b9-49c0-87a3-b7f15ff522b4 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:00.868433 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3d2bf-d1b9-49c0-87a3-b7f15ff522b4 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:00.869832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:00.876642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84d540-e366-4cea-b871-6abdfca295b6 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:00.877130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84d540-e366-4cea-b871-6abdfca295b6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:00.877250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84d540-e366-4cea-b871-6abdfca295b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:00.895398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-9d84d540-e366-4cea-b871-6abdfca295b6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:00.896611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9d84d540-e366-4cea-b871-6abdfca295b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:00.906787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:00.946894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3d2bf-d1b9-49c0-87a3-b7f15ff522b4 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:00.958646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3d2bf-d1b9-49c0-87a3-b7f15ff522b4 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:00.962298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b712b-7355-426e-b84c-ae4836b8f1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:00.962972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b712b-7355-426e-b84c-ae4836b8f1ee service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:00.963260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b712b-7355-426e-b84c-ae4836b8f1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:00.963543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b712b-7355-426e-b84c-ae4836b8f1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:00.973767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b712b-7355-426e-b84c-ae4836b8f1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:00.975351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b712b-7355-426e-b84c-ae4836b8f1ee service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:00.985944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 725/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:03.223254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be232d4-619b-495f-975e-840b9b5616f7 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:03.223819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be232d4-619b-495f-975e-840b9b5616f7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:03.223819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be232d4-619b-495f-975e-840b9b5616f7 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:03.225185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:03.230842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84b937-862c-4925-87a9-9d264993e48c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:03.231337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84b937-862c-4925-87a9-9d264993e48c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:03.231452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84b937-862c-4925-87a9-9d264993e48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:03.249232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3b84b937-862c-4925-87a9-9d264993e48c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:03.250485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3b84b937-862c-4925-87a9-9d264993e48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:03.258464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:03.300376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be232d4-619b-495f-975e-840b9b5616f7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:03.311218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be232d4-619b-495f-975e-840b9b5616f7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:03.314788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504bf5d-f4d9-4116-af0d-62d6d465e451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:03.315431 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504bf5d-f4d9-4116-af0d-62d6d465e451 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:03.315694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504bf5d-f4d9-4116-af0d-62d6d465e451 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:03.315971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504bf5d-f4d9-4116-af0d-62d6d465e451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:03.326352 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504bf5d-f4d9-4116-af0d-62d6d465e451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:03.327796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504bf5d-f4d9-4116-af0d-62d6d465e451 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:03.339553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 732/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:05.487532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07485b86-ec0a-417e-ae42-89941660d1cd None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:05.488083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07485b86-ec0a-417e-ae42-89941660d1cd None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:05.488223 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07485b86-ec0a-417e-ae42-89941660d1cd None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:05.489494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:05.495298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27ef44-ca9a-48c1-8ab6-3a6b123c574a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:05.495810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27ef44-ca9a-48c1-8ab6-3a6b123c574a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:05.495925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27ef44-ca9a-48c1-8ab6-3a6b123c574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:05.501974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=70 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:44:05.515300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ec27ef44-ca9a-48c1-8ab6-3a6b123c574a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:05.516414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ec27ef44-ca9a-48c1-8ab6-3a6b123c574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:05.529132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:05.570067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07485b86-ec0a-417e-ae42-89941660d1cd None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:05.575531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=73 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:44:05.582896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07485b86-ec0a-417e-ae42-89941660d1cd None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:05.587385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cb854-71d7-4b79-8d39-c2722fa59a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:05.588474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb854-71d7-4b79-8d39-c2722fa59a1d service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:05.588928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb854-71d7-4b79-8d39-c2722fa59a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:05.589403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cb854-71d7-4b79-8d39-c2722fa59a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:05.600307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb854-71d7-4b79-8d39-c2722fa59a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:05.601700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cb854-71d7-4b79-8d39-c2722fa59a1d service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:05.612264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 728/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:07.744385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431887-22b9-4b50-a0b5-69039a921326 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:07.744932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431887-22b9-4b50-a0b5-69039a921326 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:07.744932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3431887-22b9-4b50-a0b5-69039a921326 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:07.746310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:07.752160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31979e0-7615-48e6-a248-15be8825e48d None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:07.753230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31979e0-7615-48e6-a248-15be8825e48d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:07.753328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31979e0-7615-48e6-a248-15be8825e48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:07.771982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a31979e0-7615-48e6-a248-15be8825e48d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:07.773225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a31979e0-7615-48e6-a248-15be8825e48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:07.781394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:07.820712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3431887-22b9-4b50-a0b5-69039a921326 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:07.832506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3431887-22b9-4b50-a0b5-69039a921326 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:07.836976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bcf29-3e90-4a54-acd5-a066681e91e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:07.838064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bcf29-3e90-4a54-acd5-a066681e91e2 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:07.838461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bcf29-3e90-4a54-acd5-a066681e91e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:07.838938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bcf29-3e90-4a54-acd5-a066681e91e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:07.849385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bcf29-3e90-4a54-acd5-a066681e91e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:07.850874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bcf29-3e90-4a54-acd5-a066681e91e2 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:07.860705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 735/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:09.984982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f9ac0-2773-4c7b-a2b9-95264a3255f5 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:09.985564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f9ac0-2773-4c7b-a2b9-95264a3255f5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:09.985564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f9ac0-2773-4c7b-a2b9-95264a3255f5 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:09.987614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:09.993267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9d94a-be77-412e-8cbe-134da9b034bf None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:09.993791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9d94a-be77-412e-8cbe-134da9b034bf None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:09.993886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9d94a-be77-412e-8cbe-134da9b034bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:10.012762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-5fb9d94a-be77-412e-8cbe-134da9b034bf None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:10.014006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5fb9d94a-be77-412e-8cbe-134da9b034bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:10.022128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:10.059035 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f9ac0-2773-4c7b-a2b9-95264a3255f5 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:10.071054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f9ac0-2773-4c7b-a2b9-95264a3255f5 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:10.074606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf5d0-0d7c-4381-a19e-edbd433aa305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:10.075248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf5d0-0d7c-4381-a19e-edbd433aa305 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:10.075540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf5d0-0d7c-4381-a19e-edbd433aa305 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:10.075821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf5d0-0d7c-4381-a19e-edbd433aa305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:10.085833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf5d0-0d7c-4381-a19e-edbd433aa305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:10.087676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf5d0-0d7c-4381-a19e-edbd433aa305 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:10.098277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 731/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:12.169244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded79b0b-7485-46b7-8ce8-69d9d4f0f064 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:12.169783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded79b0b-7485-46b7-8ce8-69d9d4f0f064 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:12.169783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded79b0b-7485-46b7-8ce8-69d9d4f0f064 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:12.171182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:12.177976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ece8d6-addf-485b-b25d-0fee51a51313 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:12.178568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ece8d6-addf-485b-b25d-0fee51a51313 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:12.178568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ece8d6-addf-485b-b25d-0fee51a51313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:12.198685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-65ece8d6-addf-485b-b25d-0fee51a51313 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:12.199934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-65ece8d6-addf-485b-b25d-0fee51a51313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:12.208223 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:12.245083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded79b0b-7485-46b7-8ce8-69d9d4f0f064 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:12.257065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded79b0b-7485-46b7-8ce8-69d9d4f0f064 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:12.260622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6a7a4-27d7-4d49-8747-a9721810b96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:12.261269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6a7a4-27d7-4d49-8747-a9721810b96a service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:12.261556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6a7a4-27d7-4d49-8747-a9721810b96a service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:12.261841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6a7a4-27d7-4d49-8747-a9721810b96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:12.271367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6a7a4-27d7-4d49-8747-a9721810b96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:12.272805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6a7a4-27d7-4d49-8747-a9721810b96a service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:12.282775 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 738/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:22.193049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=17 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:44:22.278393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=17 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:44:32.687736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe53dfc-19bb-4e44-984d-2b0d99881705 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:32.688306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe53dfc-19bb-4e44-984d-2b0d99881705 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:32.688414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe53dfc-19bb-4e44-984d-2b0d99881705 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:32.690388 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 733/1471] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:32.696320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210461-59f6-45c3-9b89-e38b5950ec8b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:32.696826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210461-59f6-45c3-9b89-e38b5950ec8b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:32.696968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210461-59f6-45c3-9b89-e38b5950ec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:32.716031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-f0210461-59f6-45c3-9b89-e38b5950ec8b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:32.717310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f0210461-59f6-45c3-9b89-e38b5950ec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:32.726300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 739/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:32.775395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf864ba-c5f7-4a94-b247-cf4f5d2a3641 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:32.775689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf864ba-c5f7-4a94-b247-cf4f5d2a3641 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:32.775971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf864ba-c5f7-4a94-b247-cf4f5d2a3641 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:32.777348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 734/1473] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jun 23 10:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:32.782345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21fd5-5ce4-45c0-8593-57016080c0ef None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:32.782649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21fd5-5ce4-45c0-8593-57016080c0ef None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:32.782940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21fd5-5ce4-45c0-8593-57016080c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:32.801709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-21d21fd5-5ce4-45c0-8593-57016080c0ef None None] MFA Rules not processed for user `33a1696d1cc14ca6ac1cb970598f11fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:32.803041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-21d21fd5-5ce4-45c0-8593-57016080c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:32.809623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 740/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jun 23 10:44:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:32.817886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf864ba-c5f7-4a94-b247-cf4f5d2a3641 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:32.828889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf864ba-c5f7-4a94-b247-cf4f5d2a3641 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:32.833845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28dd66-9a5b-4c90-9b1c-9be85a33ce38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a1696d1cc14ca6ac1cb970598f11fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:32.834525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28dd66-9a5b-4c90-9b1c-9be85a33ce38 service glance] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:32.834813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28dd66-9a5b-4c90-9b1c-9be85a33ce38 service glance] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:32.835114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28dd66-9a5b-4c90-9b1c-9be85a33ce38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:32.844607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28dd66-9a5b-4c90-9b1c-9be85a33ce38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:32.846722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28dd66-9a5b-4c90-9b1c-9be85a33ce38 service glance] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:32.856607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 735/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:35.057154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ca089-fa94-4237-a755-0a41b1c9ea4f None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:35.057681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ca089-fa94-4237-a755-0a41b1c9ea4f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:35.057818 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ca089-fa94-4237-a755-0a41b1c9ea4f None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:35.059121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 741/1476] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:35.065314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452007c5-e888-44ad-beb3-5b20d3e03847 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:35.065314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452007c5-e888-44ad-beb3-5b20d3e03847 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:35.065314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452007c5-e888-44ad-beb3-5b20d3e03847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:35.083859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-452007c5-e888-44ad-beb3-5b20d3e03847 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:35.085089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-452007c5-e888-44ad-beb3-5b20d3e03847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:35.093131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 736/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:35.117601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ca089-fa94-4237-a755-0a41b1c9ea4f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:35.130650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ca089-fa94-4237-a755-0a41b1c9ea4f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:35.135246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742534df-1883-40f7-86b6-315e9f2156f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:35.135991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742534df-1883-40f7-86b6-315e9f2156f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:35.136284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742534df-1883-40f7-86b6-315e9f2156f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:35.136569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742534df-1883-40f7-86b6-315e9f2156f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:35.137316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742534df-1883-40f7-86b6-315e9f2156f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:35.139170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WARNING py.warnings [None req-742534df-1883-40f7-86b6-315e9f2156f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:44:35.139170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: warnings.warn(msg) Jun 23 10:44:35.139170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: Jun 23 10:44:35.140365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742534df-1883-40f7-86b6-315e9f2156f5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:35.163540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 742/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jun 23 10:44:35 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:44:37.350763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fb553-d031-40a1-bfa5-4f8c9b90feaf None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:37.351344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fb553-d031-40a1-bfa5-4f8c9b90feaf None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:37.351344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fb553-d031-40a1-bfa5-4f8c9b90feaf None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:37.352747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 737/1479] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:37.358419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f1229-b272-492d-a022-76056d961297 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:37.358924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f1229-b272-492d-a022-76056d961297 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:37.359058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f1229-b272-492d-a022-76056d961297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:37.377683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-869f1229-b272-492d-a022-76056d961297 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:37.378961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-869f1229-b272-492d-a022-76056d961297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:37.387031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 743/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:44:37.435644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fb553-d031-40a1-bfa5-4f8c9b90feaf None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:37.448313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fb553-d031-40a1-bfa5-4f8c9b90feaf None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:37.453974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeec85e-e750-40a6-9380-282040bafcc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:37.454673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeec85e-e750-40a6-9380-282040bafcc0 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:37.455011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeec85e-e750-40a6-9380-282040bafcc0 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:37.455277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeec85e-e750-40a6-9380-282040bafcc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:37.464495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeec85e-e750-40a6-9380-282040bafcc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:37.466097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeec85e-e750-40a6-9380-282040bafcc0 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:37.476774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 738/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:39.775584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe20ab-0fd6-4a45-960a-15cb701b2f1d None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:39.776357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe20ab-0fd6-4a45-960a-15cb701b2f1d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:39.776357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe20ab-0fd6-4a45-960a-15cb701b2f1d None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:39.777527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 744/1482] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:39.783485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6585a6e-0338-4293-9693-db3eb95fdf2e None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:39.783996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6585a6e-0338-4293-9693-db3eb95fdf2e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:39.784107 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6585a6e-0338-4293-9693-db3eb95fdf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:39.802705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a6585a6e-0338-4293-9693-db3eb95fdf2e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:39.803835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a6585a6e-0338-4293-9693-db3eb95fdf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:39.811790 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 739/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:39.850803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe20ab-0fd6-4a45-960a-15cb701b2f1d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:39.861944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe20ab-0fd6-4a45-960a-15cb701b2f1d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:39.866386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b57d1-9514-42de-bbc5-d499ffd0b33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:39.867034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b57d1-9514-42de-bbc5-d499ffd0b33d service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:39.867434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b57d1-9514-42de-bbc5-d499ffd0b33d service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:39.867611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b57d1-9514-42de-bbc5-d499ffd0b33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:39.877916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b57d1-9514-42de-bbc5-d499ffd0b33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:39.879407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b57d1-9514-42de-bbc5-d499ffd0b33d service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:39.889380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 745/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:42.037131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a1da-03f5-4c6e-a755-27c35fc8c189 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:42.037785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a1da-03f5-4c6e-a755-27c35fc8c189 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:42.037785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8a1da-03f5-4c6e-a755-27c35fc8c189 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:42.039227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 740/1485] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:42.044868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de598e-345f-40f0-8768-71b2852446c7 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:42.045349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de598e-345f-40f0-8768-71b2852446c7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:42.045443 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de598e-345f-40f0-8768-71b2852446c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:42.063419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-f2de598e-345f-40f0-8768-71b2852446c7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:42.065287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f2de598e-345f-40f0-8768-71b2852446c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:42.073750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 746/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:42.114618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8a1da-03f5-4c6e-a755-27c35fc8c189 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:42.125603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8a1da-03f5-4c6e-a755-27c35fc8c189 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:42.129284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d33c89-46d7-49f1-9fa5-95c0c4e0a8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:42.129936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d33c89-46d7-49f1-9fa5-95c0c4e0a8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:42.130399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d33c89-46d7-49f1-9fa5-95c0c4e0a8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:42.132158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d33c89-46d7-49f1-9fa5-95c0c4e0a8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:42.140440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d33c89-46d7-49f1-9fa5-95c0c4e0a8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:42.141881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d33c89-46d7-49f1-9fa5-95c0c4e0a8e6 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:42.153154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 741/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:44.384473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679f59-a094-465d-95af-e8d980a3e5ca None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:44.385016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679f59-a094-465d-95af-e8d980a3e5ca None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:44.385016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679f59-a094-465d-95af-e8d980a3e5ca None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:44.386804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 747/1488] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:44.393224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4d4f2-de36-4069-ad28-a548b4544ad6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:44.393696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4d4f2-de36-4069-ad28-a548b4544ad6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:44.393813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4d4f2-de36-4069-ad28-a548b4544ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:44.412214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3ee4d4f2-de36-4069-ad28-a548b4544ad6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:44.413429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3ee4d4f2-de36-4069-ad28-a548b4544ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:44.421414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 742/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:44:44.462153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679f59-a094-465d-95af-e8d980a3e5ca None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:44.479397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679f59-a094-465d-95af-e8d980a3e5ca None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:44.484562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a013a-053b-44eb-95de-582e11f8a3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:44.485208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a013a-053b-44eb-95de-582e11f8a3cd service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:44.485499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a013a-053b-44eb-95de-582e11f8a3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:44.485861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a013a-053b-44eb-95de-582e11f8a3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:44.495977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a013a-053b-44eb-95de-582e11f8a3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:44.497522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a013a-053b-44eb-95de-582e11f8a3cd service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:44.509683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 748/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:44:46.867914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c729af-ef25-426f-918c-2742009fb511 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:46.868471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c729af-ef25-426f-918c-2742009fb511 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:46.868471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c729af-ef25-426f-918c-2742009fb511 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:46.869844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 743/1491] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jun 23 10:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:44:46.875279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c495a1f-fe18-4b48-bf4e-41cc8a903754 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:46.875718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c495a1f-fe18-4b48-bf4e-41cc8a903754 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:46.875813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c495a1f-fe18-4b48-bf4e-41cc8a903754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:46.898130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-7c495a1f-fe18-4b48-bf4e-41cc8a903754 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:44:46.899375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7c495a1f-fe18-4b48-bf4e-41cc8a903754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:44:46.907602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 749/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jun 23 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:44:46.947613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c729af-ef25-426f-918c-2742009fb511 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:44:46.958652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c729af-ef25-426f-918c-2742009fb511 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:44:46.962268 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c30031-b234-4caa-8e39-0718c686a9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:44:46.962951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c30031-b234-4caa-8e39-0718c686a9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:44:46.963237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c30031-b234-4caa-8e39-0718c686a9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:44:46.963518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c30031-b234-4caa-8e39-0718c686a9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:44:46.973238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c30031-b234-4caa-8e39-0718c686a9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:44:46.974719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c30031-b234-4caa-8e39-0718c686a9a2 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:44:46.984647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 744/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:44:56.891507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=33 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:44:56.980201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=33 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:46:13.086777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55387bef-1d93-498d-a6ee-0b4c09dd22d6 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.087322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55387bef-1d93-498d-a6ee-0b4c09dd22d6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.087322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55387bef-1d93-498d-a6ee-0b4c09dd22d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.105973 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-55387bef-1d93-498d-a6ee-0b4c09dd22d6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:46:13.107212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-55387bef-1d93-498d-a6ee-0b4c09dd22d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:46:13.115606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 750/1494] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:46:13.125397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead6cd0-d974-4745-addd-8d52fb6c40eb None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.126143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead6cd0-d974-4745-addd-8d52fb6c40eb None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.126143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead6cd0-d974-4745-addd-8d52fb6c40eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.145257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-cead6cd0-d974-4745-addd-8d52fb6c40eb None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:46:13.146503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-cead6cd0-d974-4745-addd-8d52fb6c40eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:46:13.154278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 745/1495] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:46:13.159632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55387bef-1d93-498d-a6ee-0b4c09dd22d6 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:13.169312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55387bef-1d93-498d-a6ee-0b4c09dd22d6 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:13.174702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:13.175362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.175643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.175916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.176635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:46:13.176940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:13.177951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WARNING py.warnings [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:46:13.177951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: warnings.warn(msg) Jun 23 10:46:13.177951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: Jun 23 10:46:13.178893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:13.191870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 751/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:46:13.200509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead6cd0-d974-4745-addd-8d52fb6c40eb None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:13.210303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead6cd0-d974-4745-addd-8d52fb6c40eb None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:13.214943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ccf8-5bad-4cc8-a987-3f447ef0f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:13.215594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ccf8-5bad-4cc8-a987-3f447ef0f7ff admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.215881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ccf8-5bad-4cc8-a987-3f447ef0f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.216160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ccf8-5bad-4cc8-a987-3f447ef0f7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.216858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72ccf8-5bad-4cc8-a987-3f447ef0f7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:13.218695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WARNING py.warnings [None req-fc72ccf8-5bad-4cc8-a987-3f447ef0f7ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:46:13.218695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: warnings.warn(msg) Jun 23 10:46:13.218695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: Jun 23 10:46:13.221210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72ccf8-5bad-4cc8-a987-3f447ef0f7ff admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:13.258559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 746/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:46:13 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:46:13.263073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:13.273428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b01f-8fba-4c26-b591-2c8b67438a4d admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:13.329203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677be5e-8e45-47c3-a3fd-9d54357831da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:13.329817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677be5e-8e45-47c3-a3fd-9d54357831da admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.330102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677be5e-8e45-47c3-a3fd-9d54357831da admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.330418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677be5e-8e45-47c3-a3fd-9d54357831da admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.331120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677be5e-8e45-47c3-a3fd-9d54357831da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:13.332134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WARNING py.warnings [None req-0677be5e-8e45-47c3-a3fd-9d54357831da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:46:13.332134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: warnings.warn(msg) Jun 23 10:46:13.332134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: Jun 23 10:46:13.333357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677be5e-8e45-47c3-a3fd-9d54357831da admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:13.353392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 752/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:46:13 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:46:13.357509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ccf8-5bad-4cc8-a987-3f447ef0f7ff admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:13.368094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ccf8-5bad-4cc8-a987-3f447ef0f7ff admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:13.372647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1158ed9-242e-41de-9e6a-1bf4805a56fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:13.373305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1158ed9-242e-41de-9e6a-1bf4805a56fd admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.373589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1158ed9-242e-41de-9e6a-1bf4805a56fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.373867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1158ed9-242e-41de-9e6a-1bf4805a56fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.374628 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1158ed9-242e-41de-9e6a-1bf4805a56fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:13.375676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WARNING py.warnings [None req-b1158ed9-242e-41de-9e6a-1bf4805a56fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:46:13.375676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: warnings.warn(msg) Jun 23 10:46:13.375676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: Jun 23 10:46:13.376563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1158ed9-242e-41de-9e6a-1bf4805a56fd admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:13.389266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 747/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:46:13.394136 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677be5e-8e45-47c3-a3fd-9d54357831da admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:13.404167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677be5e-8e45-47c3-a3fd-9d54357831da admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:13.409638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb2533-1994-4878-bb4d-b8f03a8deb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:13.410300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb2533-1994-4878-bb4d-b8f03a8deb9b admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.410632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb2533-1994-4878-bb4d-b8f03a8deb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.410911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb2533-1994-4878-bb4d-b8f03a8deb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.411637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb2533-1994-4878-bb4d-b8f03a8deb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:13.412676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WARNING py.warnings [None req-2aeb2533-1994-4878-bb4d-b8f03a8deb9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:46:13.412676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: warnings.warn(msg) Jun 23 10:46:13.412676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: Jun 23 10:46:13.413594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb2533-1994-4878-bb4d-b8f03a8deb9b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:13.427250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 753/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:46:13.431408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1158ed9-242e-41de-9e6a-1bf4805a56fd admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:13.441345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1158ed9-242e-41de-9e6a-1bf4805a56fd admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:13.446170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc0bd0-d0d9-45ab-8aed-4941f9f8aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:13.447081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc0bd0-d0d9-45ab-8aed-4941f9f8aa16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.447369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc0bd0-d0d9-45ab-8aed-4941f9f8aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.447647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc0bd0-d0d9-45ab-8aed-4941f9f8aa16 admin admin] PATH_INFO: `/v3/projects/c23a6c8f3eb24aa9b8bf556f0f0c131a/users/8ee80e5d57c44468b3c254fc51bcebe3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.463041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc0bd0-d0d9-45ab-8aed-4941f9f8aa16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23a6c8f3eb24aa9b8bf556f0f0c131a, user_id=8ee80e5d57c44468b3c254fc51bcebe3, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:13.464080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WARNING py.warnings [None req-01fc0bd0-d0d9-45ab-8aed-4941f9f8aa16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:46:13.464080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: warnings.warn(msg) Jun 23 10:46:13.464080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: Jun 23 10:46:13.466007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc0bd0-d0d9-45ab-8aed-4941f9f8aa16 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:13.480248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 748/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:46:13 2022] PUT /identity/v3/projects/c23a6c8f3eb24aa9b8bf556f0f0c131a/users/8ee80e5d57c44468b3c254fc51bcebe3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:46:13.492116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cd3b6-99b3-4e96-a8d1-f60fa81f3578 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.492407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cd3b6-99b3-4e96-a8d1-f60fa81f3578 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.492707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cd3b6-99b3-4e96-a8d1-f60fa81f3578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.520085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8e8cd3b6-99b3-4e96-a8d1-f60fa81f3578 None None] MFA Rules not processed for user `8ee80e5d57c44468b3c254fc51bcebe3`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:46:13.521299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8e8cd3b6-99b3-4e96-a8d1-f60fa81f3578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:46:13.586726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 754/1502] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:46:13.600200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466367-4d23-4902-b1d4-53d1c549e86a None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.600491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466367-4d23-4902-b1d4-53d1c549e86a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.600777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466367-4d23-4902-b1d4-53d1c549e86a None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.602145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 749/1503] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jun 23 10:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:46:13.607023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd0e9-ad74-43f1-9c26-8601557c1263 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.607313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd0e9-ad74-43f1-9c26-8601557c1263 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.607594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bd0e9-ad74-43f1-9c26-8601557c1263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.627676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-6d5bd0e9-ad74-43f1-9c26-8601557c1263 None None] MFA Rules not processed for user `0930d783a2574d5caeb2587fe4157cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:46:13.628882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6d5bd0e9-ad74-43f1-9c26-8601557c1263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:46:13.674755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:46:13.683247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 755/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jun 23 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:46:13.691407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466367-4d23-4902-b1d4-53d1c549e86a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:13.702118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466367-4d23-4902-b1d4-53d1c549e86a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:13.706507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e93e5-17b6-49a1-8da5-f9960fd6bf17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:13.707170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e93e5-17b6-49a1-8da5-f9960fd6bf17 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.707455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e93e5-17b6-49a1-8da5-f9960fd6bf17 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.707736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e93e5-17b6-49a1-8da5-f9960fd6bf17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.716262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e93e5-17b6-49a1-8da5-f9960fd6bf17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:13.717695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e93e5-17b6-49a1-8da5-f9960fd6bf17 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:13.727018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 750/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:46:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:46:13.769672 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb2f2c-089f-493a-8ba8-5a606984b6cd None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.769965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb2f2c-089f-493a-8ba8-5a606984b6cd None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.770249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb2f2c-089f-493a-8ba8-5a606984b6cd None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.771581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 756/1506] 10.222.0.39 () {52 vars in 829 bytes} [Thu Jun 23 10:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:46:13.775364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e93e5-17b6-49a1-8da5-f9960fd6bf17 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:13.837987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e93e5-17b6-49a1-8da5-f9960fd6bf17 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:13.842400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:13.843261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.843543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.843821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] PATH_INFO: `/v3/users/8ee80e5d57c44468b3c254fc51bcebe3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.845775 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee80e5d57c44468b3c254fc51bcebe3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:13.846884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WARNING py.warnings [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:46:13.846884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: warnings.warn(msg) Jun 23 10:46:13.846884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: Jun 23 10:46:13.848092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:13.912961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee80e5d57c44468b3c254fc51bcebe3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:13.913621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee80e5d57c44468b3c254fc51bcebe3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:13.933729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee80e5d57c44468b3c254fc51bcebe3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:13.946166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee80e5d57c44468b3c254fc51bcebe3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:13.950115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:46:13.955606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee80e5d57c44468b3c254fc51bcebe3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:13.963529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 751/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:46:13 2022] DELETE /identity/v3/users/8ee80e5d57c44468b3c254fc51bcebe3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:46:13.968843 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d8463-b6fc-450c-b74c-2a57d0e493e0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:13.969791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d8463-b6fc-450c-b74c-2a57d0e493e0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:13.970080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d8463-b6fc-450c-b74c-2a57d0e493e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:13.987909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e11d8463-b6fc-450c-b74c-2a57d0e493e0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:46:13.989126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e11d8463-b6fc-450c-b74c-2a57d0e493e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:46:14.048116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 757/1508] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:46:14.057640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:14.059171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:46:14.117395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ba466-d17b-4fab-bc0b-ff6923a6f107 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:14.120950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaf07a-483b-4d24-ba15-ac22d97d8d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:14.121598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaf07a-483b-4d24-ba15-ac22d97d8d6d service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:14.121887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaf07a-483b-4d24-ba15-ac22d97d8d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:14.122168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaf07a-483b-4d24-ba15-ac22d97d8d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:14.131313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaf07a-483b-4d24-ba15-ac22d97d8d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:14.132767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaf07a-483b-4d24-ba15-ac22d97d8d6d service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:14.142879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 752/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:46:14.494878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d8463-b6fc-450c-b74c-2a57d0e493e0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:46:14.496444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e11d8463-b6fc-450c-b74c-2a57d0e493e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:46:14.509223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d8463-b6fc-450c-b74c-2a57d0e493e0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:46:14.513927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:46:14.514729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:46:14.515015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:46:14.515296 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] PATH_INFO: `/v3/projects/c23a6c8f3eb24aa9b8bf556f0f0c131a` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:46:14.517379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23a6c8f3eb24aa9b8bf556f0f0c131a)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:46:14.518515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WARNING py.warnings [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:46:14.518515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: warnings.warn(msg) Jun 23 10:46:14.518515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: Jun 23 10:46:14.520256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:46:14.586620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23a6c8f3eb24aa9b8bf556f0f0c131a', 'request_id': 'req-f03d5d83-9067-4ef5-8447-cd44a8907f31'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:14.597030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23a6c8f3eb24aa9b8bf556f0f0c131a', 'request_id': 'req-f03d5d83-9067-4ef5-8447-cd44a8907f31'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:14.613355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23a6c8f3eb24aa9b8bf556f0f0c131a', 'request_id': 'req-f03d5d83-9067-4ef5-8447-cd44a8907f31'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:14.624709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] The token cache is being invalidate because project c23a6c8f3eb24aa9b8bf556f0f0c131a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:46:14.624940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:14.625733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f03d5d83-9067-4ef5-8447-cd44a8907f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:46:14.627547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 758/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:46:14 2022] DELETE /identity/v3/projects/c23a6c8f3eb24aa9b8bf556f0f0c131a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:46:24.138135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:46:24.621571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:47:53.999699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72d60-f679-4db7-bffd-c92ab0e4abbb None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:47:54.000292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72d60-f679-4db7-bffd-c92ab0e4abbb None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:47:54.000292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae72d60-f679-4db7-bffd-c92ab0e4abbb None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:47:54.002252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:47:54.007091 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f8153-22e5-4edb-a9c0-4efa6a291260 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:47:54.007523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f8153-22e5-4edb-a9c0-4efa6a291260 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:47:54.007642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f8153-22e5-4edb-a9c0-4efa6a291260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:47:54.025546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-5e2f8153-22e5-4edb-a9c0-4efa6a291260 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:47:54.026799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5e2f8153-22e5-4edb-a9c0-4efa6a291260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:47:54.084974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:47:54.240357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72d60-f679-4db7-bffd-c92ab0e4abbb None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:47:54.242060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6ae72d60-f679-4db7-bffd-c92ab0e4abbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:47:54.316142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae72d60-f679-4db7-bffd-c92ab0e4abbb None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:47:54.321741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b235d-4056-48dc-aeab-3e50e294b481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:47:54.322403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b235d-4056-48dc-aeab-3e50e294b481 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:47:54.322690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b235d-4056-48dc-aeab-3e50e294b481 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:47:54.322968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b235d-4056-48dc-aeab-3e50e294b481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:47:54.331146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b235d-4056-48dc-aeab-3e50e294b481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:47:54.332762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b235d-4056-48dc-aeab-3e50e294b481 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:47:54.341966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 754/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:47:55.178168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cde14-1a37-4e28-a423-4f2ec8f5514c None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:47:55.178811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cde14-1a37-4e28-a423-4f2ec8f5514c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:47:55.178811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cde14-1a37-4e28-a423-4f2ec8f5514c None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:47:55.180176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:47:55.185398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56a15-6137-470a-b81f-d87bb1c41be7 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:47:55.185835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56a15-6137-470a-b81f-d87bb1c41be7 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:47:55.185967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b56a15-6137-470a-b81f-d87bb1c41be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:47:55.205380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-84b56a15-6137-470a-b81f-d87bb1c41be7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:47:55.206605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-84b56a15-6137-470a-b81f-d87bb1c41be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:47:55.214697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:47:55.374830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cde14-1a37-4e28-a423-4f2ec8f5514c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:47:55.390114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cde14-1a37-4e28-a423-4f2ec8f5514c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:47:55.396031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740566a-ef88-435a-8b9e-976572c66724 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:47:55.396662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740566a-ef88-435a-8b9e-976572c66724 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:47:55.396948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740566a-ef88-435a-8b9e-976572c66724 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:47:55.397229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740566a-ef88-435a-8b9e-976572c66724 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:47:55.405714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740566a-ef88-435a-8b9e-976572c66724 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:47:55.407423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740566a-ef88-435a-8b9e-976572c66724 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:47:55.417042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 761/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:47:57.203824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887769bd-0088-45b7-81ae-3877b8d8b70c None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:47:57.204375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887769bd-0088-45b7-81ae-3877b8d8b70c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:47:57.204375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887769bd-0088-45b7-81ae-3877b8d8b70c None None] PATH_INFO: `/v3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:47:57.205706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 756/1517] 10.222.0.47 () {54 vars in 925 bytes} [Thu Jun 23 10:47:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:47:57.212334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394ea77-1c12-4db6-9d15-7a26ec4cf2f1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:47:57.212769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394ea77-1c12-4db6-9d15-7a26ec4cf2f1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:47:57.212885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394ea77-1c12-4db6-9d15-7a26ec4cf2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:47:57.231273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0394ea77-1c12-4db6-9d15-7a26ec4cf2f1 None None] MFA Rules not processed for user `64ce422f60d64b368df8be61e1065282`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:47:57.232503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0394ea77-1c12-4db6-9d15-7a26ec4cf2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:47:57.293057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 762/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 23 10:47:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:48:01.104933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460774-ec38-4be4-bd0f-14304c02cd65 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:01.110682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460774-ec38-4be4-bd0f-14304c02cd65 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:01.110682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8460774-ec38-4be4-bd0f-14304c02cd65 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:01.110682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 757/1519] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jun 23 10:48:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:01.114668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4d992-d6cd-4d4e-b324-933688865463 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:01.115092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4d992-d6cd-4d4e-b324-933688865463 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:01.115231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4d992-d6cd-4d4e-b324-933688865463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:01.133197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-dac4d992-d6cd-4d4e-b324-933688865463 None None] MFA Rules not processed for user `64ce422f60d64b368df8be61e1065282`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:01.134419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-dac4d992-d6cd-4d4e-b324-933688865463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:01.142878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 763/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jun 23 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:48:01.150975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8460774-ec38-4be4-bd0f-14304c02cd65 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:01.165947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8460774-ec38-4be4-bd0f-14304c02cd65 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:01.170908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17a1b6-57ca-4975-8307-563545d0214f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:01.171537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a1b6-57ca-4975-8307-563545d0214f service placement] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:01.171821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a1b6-57ca-4975-8307-563545d0214f service placement] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:01.172197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a1b6-57ca-4975-8307-563545d0214f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:01.181882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17a1b6-57ca-4975-8307-563545d0214f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:01.183510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17a1b6-57ca-4975-8307-563545d0214f service placement] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:01.194204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 758/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:48:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:48:06.646992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91effe3b-fdf9-4a4d-baf8-6ef0633472ed None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:06.647545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91effe3b-fdf9-4a4d-baf8-6ef0633472ed None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:06.647648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91effe3b-fdf9-4a4d-baf8-6ef0633472ed None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:06.648985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:06.653837 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d3faf-5aa0-412d-a1c9-65352ff27e5a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:06.654262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d3faf-5aa0-412d-a1c9-65352ff27e5a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:06.654456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d3faf-5aa0-412d-a1c9-65352ff27e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:06.674905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c90d3faf-5aa0-412d-a1c9-65352ff27e5a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:06.676118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c90d3faf-5aa0-412d-a1c9-65352ff27e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:06.684196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:48:06.841587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91effe3b-fdf9-4a4d-baf8-6ef0633472ed None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:06.856395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91effe3b-fdf9-4a4d-baf8-6ef0633472ed None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:06.862477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d7dda-bd45-43ff-b56a-ab38a8c4ef79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:06.863126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7dda-bd45-43ff-b56a-ab38a8c4ef79 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:06.863410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7dda-bd45-43ff-b56a-ab38a8c4ef79 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:06.863685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d7dda-bd45-43ff-b56a-ab38a8c4ef79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:06.872092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7dda-bd45-43ff-b56a-ab38a8c4ef79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:06.873721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d7dda-bd45-43ff-b56a-ab38a8c4ef79 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:06.884407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 765/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:48:07.720069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b2215-f95d-4afd-a029-95de77f9ed95 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:07.720644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b2215-f95d-4afd-a029-95de77f9ed95 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:07.720644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b2215-f95d-4afd-a029-95de77f9ed95 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:07.721987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 10:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:07.727257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c1f2-1faf-4a11-b0af-aa28c9861f6f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:07.727678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c1f2-1faf-4a11-b0af-aa28c9861f6f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:07.727851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c1f2-1faf-4a11-b0af-aa28c9861f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:07.745750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e297c1f2-1faf-4a11-b0af-aa28c9861f6f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:07.747030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e297c1f2-1faf-4a11-b0af-aa28c9861f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:07.755733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 10:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:48:07.906805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b2215-f95d-4afd-a029-95de77f9ed95 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:07.920858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b2215-f95d-4afd-a029-95de77f9ed95 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:07.926650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475bd80-3292-43ff-bb5e-47504ce1e69f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:07.927273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475bd80-3292-43ff-bb5e-47504ce1e69f service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:07.927551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475bd80-3292-43ff-bb5e-47504ce1e69f service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:07.927823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475bd80-3292-43ff-bb5e-47504ce1e69f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:07.935731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475bd80-3292-43ff-bb5e-47504ce1e69f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:07.937298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475bd80-3292-43ff-bb5e-47504ce1e69f service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:07.948150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 761/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:48:11.807320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905686c0-69c7-467e-b32d-5eae5a9e59eb None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:11.807850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905686c0-69c7-467e-b32d-5eae5a9e59eb None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:11.807850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905686c0-69c7-467e-b32d-5eae5a9e59eb None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:11.809174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:11.815221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55b13f-d7d9-4fb2-ba18-c3978b7f40f6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:11.815659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55b13f-d7d9-4fb2-ba18-c3978b7f40f6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:11.815810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55b13f-d7d9-4fb2-ba18-c3978b7f40f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:11.834218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0f55b13f-d7d9-4fb2-ba18-c3978b7f40f6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:11.835463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0f55b13f-d7d9-4fb2-ba18-c3978b7f40f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:11.844839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:48:11.881851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905686c0-69c7-467e-b32d-5eae5a9e59eb None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:11.883574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-905686c0-69c7-467e-b32d-5eae5a9e59eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:11.940805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905686c0-69c7-467e-b32d-5eae5a9e59eb None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:11.944706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c049bc-a2e8-4385-ba3d-836c72b14c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:11.945342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c049bc-a2e8-4385-ba3d-836c72b14c83 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:11.945622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c049bc-a2e8-4385-ba3d-836c72b14c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:11.946157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c049bc-a2e8-4385-ba3d-836c72b14c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:11.955171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c049bc-a2e8-4385-ba3d-836c72b14c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:11.956593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c049bc-a2e8-4385-ba3d-836c72b14c83 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:11.961392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:11.967152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 768/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:48:13.983328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ba3a-b50a-45ca-9a15-6b6a8cb2a9c6 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:13.983894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ba3a-b50a-45ca-9a15-6b6a8cb2a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:13.983894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9ba3a-b50a-45ca-9a15-6b6a8cb2a9c6 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:13.986585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:48:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:13.992004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1482047-4fd2-4df8-b323-d32d7d29c1ca None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:13.992427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1482047-4fd2-4df8-b323-d32d7d29c1ca None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:13.992562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1482047-4fd2-4df8-b323-d32d7d29c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:14.011590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a1482047-4fd2-4df8-b323-d32d7d29c1ca None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:14.012808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a1482047-4fd2-4df8-b323-d32d7d29c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:14.021156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:48:14.057263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ba3a-b50a-45ca-9a15-6b6a8cb2a9c6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:14.068988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9ba3a-b50a-45ca-9a15-6b6a8cb2a9c6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:14.072743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32becf98-4461-4ef6-a21b-b8e353151394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:14.073368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32becf98-4461-4ef6-a21b-b8e353151394 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:14.073652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32becf98-4461-4ef6-a21b-b8e353151394 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:14.073931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32becf98-4461-4ef6-a21b-b8e353151394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:14.083185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32becf98-4461-4ef6-a21b-b8e353151394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:14.084609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32becf98-4461-4ef6-a21b-b8e353151394 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:14.094478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 764/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:48:17.619208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a9893-fd1f-40b2-ac96-0ae4b7fccf91 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:17.619774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a9893-fd1f-40b2-ac96-0ae4b7fccf91 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:17.619774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a9893-fd1f-40b2-ac96-0ae4b7fccf91 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:17.621140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:17.626446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f70ec9-a3e1-4620-86a8-c8e297121558 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:17.626877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f70ec9-a3e1-4620-86a8-c8e297121558 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:17.626995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f70ec9-a3e1-4620-86a8-c8e297121558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:17.644509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-e6f70ec9-a3e1-4620-86a8-c8e297121558 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:17.645696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e6f70ec9-a3e1-4620-86a8-c8e297121558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:17.653248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:48:17.956686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a9893-fd1f-40b2-ac96-0ae4b7fccf91 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:17.958417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-1b7a9893-fd1f-40b2-ac96-0ae4b7fccf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:18.013976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a9893-fd1f-40b2-ac96-0ae4b7fccf91 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:18.018230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6539b88-4d37-4efa-8d4d-0f415022e9a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:18.018890 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6539b88-4d37-4efa-8d4d-0f415022e9a0 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:18.019175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6539b88-4d37-4efa-8d4d-0f415022e9a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:18.019457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6539b88-4d37-4efa-8d4d-0f415022e9a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:18.028333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6539b88-4d37-4efa-8d4d-0f415022e9a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:18.029752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6539b88-4d37-4efa-8d4d-0f415022e9a0 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:18.039153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 771/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:48:20.114079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77778170-0da1-41ff-94cd-54bc3e6d96b3 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:20.114694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77778170-0da1-41ff-94cd-54bc3e6d96b3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:20.114694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77778170-0da1-41ff-94cd-54bc3e6d96b3 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:20.116104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 10:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:20.121608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e936e18-b317-456c-b6a0-5d219c0ad573 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:20.122082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e936e18-b317-456c-b6a0-5d219c0ad573 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:20.122264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e936e18-b317-456c-b6a0-5d219c0ad573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:20.141475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-6e936e18-b317-456c-b6a0-5d219c0ad573 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:20.142715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6e936e18-b317-456c-b6a0-5d219c0ad573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:20.150426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:48:20.455527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77778170-0da1-41ff-94cd-54bc3e6d96b3 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:20.457271 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-77778170-0da1-41ff-94cd-54bc3e6d96b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:20.470761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77778170-0da1-41ff-94cd-54bc3e6d96b3 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:20.474196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad734a-d069-4098-b1b8-56604cf39e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:20.474848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad734a-d069-4098-b1b8-56604cf39e0b service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:20.475130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad734a-d069-4098-b1b8-56604cf39e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:20.475407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad734a-d069-4098-b1b8-56604cf39e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:20.485650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad734a-d069-4098-b1b8-56604cf39e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:20.487450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad734a-d069-4098-b1b8-56604cf39e0b service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:20.499371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 767/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:48:30.135861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=32 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:30.495076 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=70 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:48.647814 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcb330-20c6-41a7-afaf-8aee1d76bfbf None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:48.648420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcb330-20c6-41a7-afaf-8aee1d76bfbf None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:48.648420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcb330-20c6-41a7-afaf-8aee1d76bfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:48.674830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-30dcb330-20c6-41a7-afaf-8aee1d76bfbf None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:48.676215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-30dcb330-20c6-41a7-afaf-8aee1d76bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:48.687605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 773/1540] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:48.699326 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85445-9bd6-4adc-9f4e-08dd7b94e2fc None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:48.699899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85445-9bd6-4adc-9f4e-08dd7b94e2fc None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:48.699899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85445-9bd6-4adc-9f4e-08dd7b94e2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:48.731367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a3a85445-9bd6-4adc-9f4e-08dd7b94e2fc None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:48.732748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a3a85445-9bd6-4adc-9f4e-08dd7b94e2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:48.746391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 768/1541] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:48.750910 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcb330-20c6-41a7-afaf-8aee1d76bfbf None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:48.768879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcb330-20c6-41a7-afaf-8aee1d76bfbf None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:48.773727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4455fc-f53b-48a9-9f64-aca1f900b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:48.774437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4455fc-f53b-48a9-9f64-aca1f900b9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:48.774725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4455fc-f53b-48a9-9f64-aca1f900b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:48.775006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4455fc-f53b-48a9-9f64-aca1f900b9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:48.775743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4455fc-f53b-48a9-9f64-aca1f900b9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:48.776057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4455fc-f53b-48a9-9f64-aca1f900b9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:48.777896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4455fc-f53b-48a9-9f64-aca1f900b9b6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:48.800589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 774/1542] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:48.808947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a85445-9bd6-4adc-9f4e-08dd7b94e2fc None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:48.825455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a85445-9bd6-4adc-9f4e-08dd7b94e2fc None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:48.831543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c7fe0-2122-43fa-b4fe-516f0a9847a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:48.832236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c7fe0-2122-43fa-b4fe-516f0a9847a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:48.832792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c7fe0-2122-43fa-b4fe-516f0a9847a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:48.833085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c7fe0-2122-43fa-b4fe-516f0a9847a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:48.833812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c7fe0-2122-43fa-b4fe-516f0a9847a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:48.836000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c7fe0-2122-43fa-b4fe-516f0a9847a9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:48.892835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 769/1543] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:48 2022] POST /identity/v3/projects => generated 365 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:48.897408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4455fc-f53b-48a9-9f64-aca1f900b9b6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:48.917270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4455fc-f53b-48a9-9f64-aca1f900b9b6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:48.954116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6769691-7a34-4845-852d-e290d4372f15 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:48.954494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6769691-7a34-4845-852d-e290d4372f15 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:48.954715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6769691-7a34-4845-852d-e290d4372f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:48.991511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d6769691-7a34-4845-852d-e290d4372f15 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:48.993162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d6769691-7a34-4845-852d-e290d4372f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.024762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f187-80cd-47e6-ba02-3af1d0a412dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.025458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f187-80cd-47e6-ba02-3af1d0a412dd admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.025744 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f187-80cd-47e6-ba02-3af1d0a412dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.026030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f187-80cd-47e6-ba02-3af1d0a412dd admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.026780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679f187-80cd-47e6-ba02-3af1d0a412dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.028805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679f187-80cd-47e6-ba02-3af1d0a412dd admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.082502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 775/1544] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:48 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:49.086501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f187-80cd-47e6-ba02-3af1d0a412dd admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.088103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 770/1545] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.099834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f949a5-f5e6-431d-b797-9e5f6e649a8f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.100207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f949a5-f5e6-431d-b797-9e5f6e649a8f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.100405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f949a5-f5e6-431d-b797-9e5f6e649a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.104058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f187-80cd-47e6-ba02-3af1d0a412dd admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.116317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605877af-ea51-4836-b167-9403a00fd4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.117010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605877af-ea51-4836-b167-9403a00fd4dd admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.117299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605877af-ea51-4836-b167-9403a00fd4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.117582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605877af-ea51-4836-b167-9403a00fd4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.118334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605877af-ea51-4836-b167-9403a00fd4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.119989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605877af-ea51-4836-b167-9403a00fd4dd admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.133810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-e6f949a5-f5e6-431d-b797-9e5f6e649a8f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.135638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e6f949a5-f5e6-431d-b797-9e5f6e649a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.139770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 776/1546] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:49.141602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a05a1c-2584-4b73-8005-b83c73fe67e1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.141899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a05a1c-2584-4b73-8005-b83c73fe67e1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.142231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a05a1c-2584-4b73-8005-b83c73fe67e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.151505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 771/1547] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.153382 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87c4b-892d-450c-add1-8e7409f4908c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.153671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87c4b-892d-450c-add1-8e7409f4908c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.153955 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87c4b-892d-450c-add1-8e7409f4908c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.182763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-00a05a1c-2584-4b73-8005-b83c73fe67e1 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.184371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-00a05a1c-2584-4b73-8005-b83c73fe67e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.200438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 777/1548] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.200595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-74f87c4b-892d-450c-add1-8e7409f4908c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.202190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f49c-ad42-44c7-b406-458cf5891d31 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.203803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f49c-ad42-44c7-b406-458cf5891d31 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.204244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-74f87c4b-892d-450c-add1-8e7409f4908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.204600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999f49c-ad42-44c7-b406-458cf5891d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.225954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 772/1549] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.227547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f87c4b-892d-450c-add1-8e7409f4908c None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.243999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c999f49c-ad42-44c7-b406-458cf5891d31 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.246348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c999f49c-ad42-44c7-b406-458cf5891d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.254124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f87c4b-892d-450c-add1-8e7409f4908c None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.259209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59982c3e-0daa-460b-87cc-82e5290c0122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.260344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59982c3e-0daa-460b-87cc-82e5290c0122 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.260543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 778/1550] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.260824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59982c3e-0daa-460b-87cc-82e5290c0122 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.261428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59982c3e-0daa-460b-87cc-82e5290c0122 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.261604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f49c-ad42-44c7-b406-458cf5891d31 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.262935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59982c3e-0daa-460b-87cc-82e5290c0122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.267620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59982c3e-0daa-460b-87cc-82e5290c0122 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.278893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999f49c-ad42-44c7-b406-458cf5891d31 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.286174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386dbcd-ec3a-474d-aaed-6d57724ce3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.286994 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386dbcd-ec3a-474d-aaed-6d57724ce3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.287437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386dbcd-ec3a-474d-aaed-6d57724ce3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.287559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386dbcd-ec3a-474d-aaed-6d57724ce3f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.288278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386dbcd-ec3a-474d-aaed-6d57724ce3f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:49.288587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386dbcd-ec3a-474d-aaed-6d57724ce3f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.290667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386dbcd-ec3a-474d-aaed-6d57724ce3f6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.293632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 773/1551] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:49.297832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88744-e966-499b-b55f-0850248fe7b0 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.298340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88744-e966-499b-b55f-0850248fe7b0 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.298900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88744-e966-499b-b55f-0850248fe7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.306601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 779/1552] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:49.308021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e1ec4-329a-41d6-8dab-d2d7792a513f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.308312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e1ec4-329a-41d6-8dab-d2d7792a513f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.308592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e1ec4-329a-41d6-8dab-d2d7792a513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.323263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-53f88744-e966-499b-b55f-0850248fe7b0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.324539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-53f88744-e966-499b-b55f-0850248fe7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.326839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a36e1ec4-329a-41d6-8dab-d2d7792a513f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.328607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a36e1ec4-329a-41d6-8dab-d2d7792a513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.333261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 774/1553] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.334537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c02544-d96d-41c0-82ba-c6fef208a58b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.334835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c02544-d96d-41c0-82ba-c6fef208a58b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.335115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c02544-d96d-41c0-82ba-c6fef208a58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.344477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 780/1554] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.346524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1919c06-0a6d-477e-b919-5bdd2afaebe0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.346916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1919c06-0a6d-477e-b919-5bdd2afaebe0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.347299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1919c06-0a6d-477e-b919-5bdd2afaebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.354081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c8c02544-d96d-41c0-82ba-c6fef208a58b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.355330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c8c02544-d96d-41c0-82ba-c6fef208a58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.363982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 775/1555] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.365267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbc749-8371-4bbf-8076-ea14787b6a67 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.365565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbc749-8371-4bbf-8076-ea14787b6a67 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.365848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbc749-8371-4bbf-8076-ea14787b6a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.366146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e1919c06-0a6d-477e-b919-5bdd2afaebe0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.367685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e1919c06-0a6d-477e-b919-5bdd2afaebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.375924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 781/1556] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.377409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1919c06-0a6d-477e-b919-5bdd2afaebe0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.384611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-1fcbc749-8371-4bbf-8076-ea14787b6a67 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.385803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1fcbc749-8371-4bbf-8076-ea14787b6a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.387637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1919c06-0a6d-477e-b919-5bdd2afaebe0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.392780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc3fea-16ba-47bb-86ac-af09534fa992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.393649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc3fea-16ba-47bb-86ac-af09534fa992 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.394229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc3fea-16ba-47bb-86ac-af09534fa992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.394372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 776/1557] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.394473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc3fea-16ba-47bb-86ac-af09534fa992 admin admin] PATH_INFO: `/v3/projects/29b0fa9a006f41868d4406a2ffe7855a/users/1a583c5ef55a46788a2f5d3088922e3a/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.395269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f9cdd-8e60-4886-b350-273019b97641 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.395564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f9cdd-8e60-4886-b350-273019b97641 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.395848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f9cdd-8e60-4886-b350-273019b97641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.410063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc3fea-16ba-47bb-86ac-af09534fa992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b0fa9a006f41868d4406a2ffe7855a, user_id=1a583c5ef55a46788a2f5d3088922e3a, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.411153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WARNING py.warnings [None req-5cbc3fea-16ba-47bb-86ac-af09534fa992 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:49:49.411153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: warnings.warn(msg) Jun 23 10:49:49.411153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: Jun 23 10:49:49.413105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc3fea-16ba-47bb-86ac-af09534fa992 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.414371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-905f9cdd-8e60-4886-b350-273019b97641 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.415585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-905f9cdd-8e60-4886-b350-273019b97641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.424469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 777/1558] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.427157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f9cdd-8e60-4886-b350-273019b97641 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.437180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 782/1559] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:49 2022] PUT /identity/v3/projects/29b0fa9a006f41868d4406a2ffe7855a/users/1a583c5ef55a46788a2f5d3088922e3a/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:49.437180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dbca9-17e7-416c-bccb-706daf2dfc09 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.437180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dbca9-17e7-416c-bccb-706daf2dfc09 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.437180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dbca9-17e7-416c-bccb-706daf2dfc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.438098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f9cdd-8e60-4886-b350-273019b97641 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.455118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-346dbca9-17e7-416c-bccb-706daf2dfc09 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.456319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-346dbca9-17e7-416c-bccb-706daf2dfc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.498725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63d3ab-b5f6-46f0-974e-56e5c3f59b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.499390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63d3ab-b5f6-46f0-974e-56e5c3f59b26 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.500303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63d3ab-b5f6-46f0-974e-56e5c3f59b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.500606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63d3ab-b5f6-46f0-974e-56e5c3f59b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.501305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63d3ab-b5f6-46f0-974e-56e5c3f59b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.503519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63d3ab-b5f6-46f0-974e-56e5c3f59b26 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.505169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:49.519239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 783/1560] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.523455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dbca9-17e7-416c-bccb-706daf2dfc09 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.534986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dbca9-17e7-416c-bccb-706daf2dfc09 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.539933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b167-8f0c-413f-8ecb-caef9fb72f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.543593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 778/1561] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:49.543748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b167-8f0c-413f-8ecb-caef9fb72f80 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.543748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b167-8f0c-413f-8ecb-caef9fb72f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.543748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b167-8f0c-413f-8ecb-caef9fb72f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.544013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63d3ab-b5f6-46f0-974e-56e5c3f59b26 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.544117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b167-8f0c-413f-8ecb-caef9fb72f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:49.544117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b167-8f0c-413f-8ecb-caef9fb72f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.544331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b167-8f0c-413f-8ecb-caef9fb72f80 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.551568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:49.557790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 784/1562] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:49.559013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b167-8f0c-413f-8ecb-caef9fb72f80 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.573301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b167-8f0c-413f-8ecb-caef9fb72f80 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.607411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63d3ab-b5f6-46f0-974e-56e5c3f59b26 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.612660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600761e3-c66c-4652-af2a-14dbce634574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.613322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600761e3-c66c-4652-af2a-14dbce634574 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.613616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600761e3-c66c-4652-af2a-14dbce634574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.613891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600761e3-c66c-4652-af2a-14dbce634574 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.614650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600761e3-c66c-4652-af2a-14dbce634574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:49.614959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600761e3-c66c-4652-af2a-14dbce634574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.615975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WARNING py.warnings [None req-600761e3-c66c-4652-af2a-14dbce634574 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:49:49.615975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: warnings.warn(msg) Jun 23 10:49:49.615975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: Jun 23 10:49:49.616862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600761e3-c66c-4652-af2a-14dbce634574 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.636435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 779/1563] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:49.636435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ac8ce-c078-4b4b-b713-08b769855ce5 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.636435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ac8ce-c078-4b4b-b713-08b769855ce5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.636435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ac8ce-c078-4b4b-b713-08b769855ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.636873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3026d1-88c2-4252-8343-cdf7bf0328e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.636873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3026d1-88c2-4252-8343-cdf7bf0328e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.636873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3026d1-88c2-4252-8343-cdf7bf0328e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.636873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3026d1-88c2-4252-8343-cdf7bf0328e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.637176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3026d1-88c2-4252-8343-cdf7bf0328e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:49.637176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3026d1-88c2-4252-8343-cdf7bf0328e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.637176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3026d1-88c2-4252-8343-cdf7bf0328e5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.648512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 785/1564] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:49.649625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20374fe5-8491-4d80-b421-b783e5efb0d1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.650019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20374fe5-8491-4d80-b421-b783e5efb0d1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.650220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20374fe5-8491-4d80-b421-b783e5efb0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.650979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-4d4ac8ce-c078-4b4b-b713-08b769855ce5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.652185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4d4ac8ce-c078-4b4b-b713-08b769855ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.661904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 780/1565] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.663224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e2be-50ef-41d7-a8da-bf660228954d None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.663520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e2be-50ef-41d7-a8da-bf660228954d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.663800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875e2be-50ef-41d7-a8da-bf660228954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.671328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-20374fe5-8491-4d80-b421-b783e5efb0d1 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.672570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-20374fe5-8491-4d80-b421-b783e5efb0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.680724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 786/1566] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.681774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20374fe5-8491-4d80-b421-b783e5efb0d1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.691784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20374fe5-8491-4d80-b421-b783e5efb0d1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.694364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d875e2be-50ef-41d7-a8da-bf660228954d None None] MFA Rules not processed for user `1a583c5ef55a46788a2f5d3088922e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.695579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d875e2be-50ef-41d7-a8da-bf660228954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.696523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc652d63-d99e-4b91-85d1-0cf7a11a0e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.697440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc652d63-d99e-4b91-85d1-0cf7a11a0e66 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.697727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc652d63-d99e-4b91-85d1-0cf7a11a0e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.698009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc652d63-d99e-4b91-85d1-0cf7a11a0e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.698870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc652d63-d99e-4b91-85d1-0cf7a11a0e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:49.699925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc652d63-d99e-4b91-85d1-0cf7a11a0e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.701643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc652d63-d99e-4b91-85d1-0cf7a11a0e66 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.714616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 787/1567] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:49.715554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc652d63-d99e-4b91-85d1-0cf7a11a0e66 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.725545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc652d63-d99e-4b91-85d1-0cf7a11a0e66 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.730177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2b37f-6259-48f4-b7d2-d2998235e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.730865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2b37f-6259-48f4-b7d2-d2998235e075 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.731151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2b37f-6259-48f4-b7d2-d2998235e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.731458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2b37f-6259-48f4-b7d2-d2998235e075 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.732156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2b37f-6259-48f4-b7d2-d2998235e075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.734186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2b37f-6259-48f4-b7d2-d2998235e075 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.754867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 788/1568] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:49.755702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2b37f-6259-48f4-b7d2-d2998235e075 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.765060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2b37f-6259-48f4-b7d2-d2998235e075 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.770710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bddd4-ab08-4997-a95a-73dec5fad834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.771350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bddd4-ab08-4997-a95a-73dec5fad834 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.771636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bddd4-ab08-4997-a95a-73dec5fad834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.771922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bddd4-ab08-4997-a95a-73dec5fad834 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.772608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bddd4-ab08-4997-a95a-73dec5fad834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.773616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WARNING py.warnings [None req-a51bddd4-ab08-4997-a95a-73dec5fad834 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:49:49.773616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: warnings.warn(msg) Jun 23 10:49:49.773616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: Jun 23 10:49:49.774845 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bddd4-ab08-4997-a95a-73dec5fad834 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.774995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 781/1569] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:49.775957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e2be-50ef-41d7-a8da-bf660228954d None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.787474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875e2be-50ef-41d7-a8da-bf660228954d None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.791910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472440b-3bff-4fc5-b5b0-9a8e6c2df3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.792555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472440b-3bff-4fc5-b5b0-9a8e6c2df3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.792854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472440b-3bff-4fc5-b5b0-9a8e6c2df3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.793112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472440b-3bff-4fc5-b5b0-9a8e6c2df3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.793797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472440b-3bff-4fc5-b5b0-9a8e6c2df3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.795786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472440b-3bff-4fc5-b5b0-9a8e6c2df3b1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.805786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 789/1570] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:49.806765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bddd4-ab08-4997-a95a-73dec5fad834 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.829374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 782/1571] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:49.829374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472440b-3bff-4fc5-b5b0-9a8e6c2df3b1 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.869750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bddd4-ab08-4997-a95a-73dec5fad834 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.888322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:49.893251 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472440b-3bff-4fc5-b5b0-9a8e6c2df3b1 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.898425 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d60f35-1980-4165-ba26-c2ea36f2232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.899170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d60f35-1980-4165-ba26-c2ea36f2232a admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.899442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d60f35-1980-4165-ba26-c2ea36f2232a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.899721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d60f35-1980-4165-ba26-c2ea36f2232a admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.900445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d60f35-1980-4165-ba26-c2ea36f2232a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:49.900869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d60f35-1980-4165-ba26-c2ea36f2232a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.902505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d60f35-1980-4165-ba26-c2ea36f2232a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.905175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:49.917096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 783/1572] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:49.918084 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d60f35-1980-4165-ba26-c2ea36f2232a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.932069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50448c72-3823-4f6b-b398-9f1c30fa68f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.932738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50448c72-3823-4f6b-b398-9f1c30fa68f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.933025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50448c72-3823-4f6b-b398-9f1c30fa68f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.933307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50448c72-3823-4f6b-b398-9f1c30fa68f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.934007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50448c72-3823-4f6b-b398-9f1c30fa68f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.934101 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d60f35-1980-4165-ba26-c2ea36f2232a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.935998 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50448c72-3823-4f6b-b398-9f1c30fa68f6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.938901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93def3f-a345-498e-903e-23226344279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.939546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93def3f-a345-498e-903e-23226344279b admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.939826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93def3f-a345-498e-903e-23226344279b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.940107 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93def3f-a345-498e-903e-23226344279b admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.940849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93def3f-a345-498e-903e-23226344279b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:49.941156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93def3f-a345-498e-903e-23226344279b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.942818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93def3f-a345-498e-903e-23226344279b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.959263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 784/1573] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:49.960096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93def3f-a345-498e-903e-23226344279b admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.964740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 790/1574] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:49.965396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50448c72-3823-4f6b-b398-9f1c30fa68f6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.975946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93def3f-a345-498e-903e-23226344279b admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.038219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50448c72-3823-4f6b-b398-9f1c30fa68f6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.040205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee592578-ef3e-445f-92d7-2474c9a05d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.040966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee592578-ef3e-445f-92d7-2474c9a05d90 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.041398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee592578-ef3e-445f-92d7-2474c9a05d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.041808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee592578-ef3e-445f-92d7-2474c9a05d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.042678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee592578-ef3e-445f-92d7-2474c9a05d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.043677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fcd05-ce49-4c8a-967f-30a48712fb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.044332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fcd05-ce49-4c8a-967f-30a48712fb13 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.044595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee592578-ef3e-445f-92d7-2474c9a05d90 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.044718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fcd05-ce49-4c8a-967f-30a48712fb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.044879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fcd05-ce49-4c8a-967f-30a48712fb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.045600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fcd05-ce49-4c8a-967f-30a48712fb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.047734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fcd05-ce49-4c8a-967f-30a48712fb13 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.058537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 791/1575] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.059347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fcd05-ce49-4c8a-967f-30a48712fb13 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.076078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 785/1576] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.076821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee592578-ef3e-445f-92d7-2474c9a05d90 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.120043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fcd05-ce49-4c8a-967f-30a48712fb13 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.139516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee592578-ef3e-445f-92d7-2474c9a05d90 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.147749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a7099-8c65-4619-b753-36346e6a8c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.148246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7099-8c65-4619-b753-36346e6a8c26 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.148534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7099-8c65-4619-b753-36346e6a8c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.148905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a7099-8c65-4619-b753-36346e6a8c26 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.149519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a7099-8c65-4619-b753-36346e6a8c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.150562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WARNING py.warnings [None req-af7a7099-8c65-4619-b753-36346e6a8c26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:49:50.150562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: warnings.warn(msg) Jun 23 10:49:50.150562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: Jun 23 10:49:50.152117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a7099-8c65-4619-b753-36346e6a8c26 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.172739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 786/1577] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.173530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a7099-8c65-4619-b753-36346e6a8c26 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.177342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b0613-0255-479e-b8dd-cdfc24a3176e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.178001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b0613-0255-479e-b8dd-cdfc24a3176e service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.178287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b0613-0255-479e-b8dd-cdfc24a3176e service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.178637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b0613-0255-479e-b8dd-cdfc24a3176e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.184040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a7099-8c65-4619-b753-36346e6a8c26 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.189331 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b5160-d116-4273-9f28-8d3f58109a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.189967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b5160-d116-4273-9f28-8d3f58109a70 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.190248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b5160-d116-4273-9f28-8d3f58109a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.190555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b5160-d116-4273-9f28-8d3f58109a70 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.191279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b5160-d116-4273-9f28-8d3f58109a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.192308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:50.193590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b5160-d116-4273-9f28-8d3f58109a70 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.214219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 787/1578] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.215816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b5160-d116-4273-9f28-8d3f58109a70 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.226217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b5160-d116-4273-9f28-8d3f58109a70 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.230741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ccb80-f012-4394-8ede-367a6d1d72fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.231365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ccb80-f012-4394-8ede-367a6d1d72fb admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.231657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ccb80-f012-4394-8ede-367a6d1d72fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.231914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ccb80-f012-4394-8ede-367a6d1d72fb admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.232637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ccb80-f012-4394-8ede-367a6d1d72fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.234902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ccb80-f012-4394-8ede-367a6d1d72fb admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.241306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b0613-0255-479e-b8dd-cdfc24a3176e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.242786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b0613-0255-479e-b8dd-cdfc24a3176e service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.252718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 792/1579] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:50.255222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b0613-0255-479e-b8dd-cdfc24a3176e service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.262726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 788/1580] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.263556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ccb80-f012-4394-8ede-367a6d1d72fb admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.266781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b0613-0255-479e-b8dd-cdfc24a3176e service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.284991 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:50.330776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a8ab7-34b2-4b91-9139-8e2941c92048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.331581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8ab7-34b2-4b91-9139-8e2941c92048 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.331881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8ab7-34b2-4b91-9139-8e2941c92048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.332141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8ab7-34b2-4b91-9139-8e2941c92048 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.332845 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a8ab7-34b2-4b91-9139-8e2941c92048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.334815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a8ab7-34b2-4b91-9139-8e2941c92048 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.336771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ccb80-f012-4394-8ede-367a6d1d72fb admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.343151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051cbed-d426-49d7-900d-0348d1bbcd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.344763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051cbed-d426-49d7-900d-0348d1bbcd55 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.345049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051cbed-d426-49d7-900d-0348d1bbcd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.345350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051cbed-d426-49d7-900d-0348d1bbcd55 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.346513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051cbed-d426-49d7-900d-0348d1bbcd55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.348877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051cbed-d426-49d7-900d-0348d1bbcd55 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.360528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 793/1581] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.360528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a8ab7-34b2-4b91-9139-8e2941c92048 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.372538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a8ab7-34b2-4b91-9139-8e2941c92048 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.380850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f9e80-c37b-455e-9294-547be2082f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.381495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 789/1582] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.382047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f9e80-c37b-455e-9294-547be2082f1c admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.382299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051cbed-d426-49d7-900d-0348d1bbcd55 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.382556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f9e80-c37b-455e-9294-547be2082f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.382917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f9e80-c37b-455e-9294-547be2082f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.383855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f9e80-c37b-455e-9294-547be2082f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.385550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f9e80-c37b-455e-9294-547be2082f1c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.399327 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 794/1583] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.400287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f9e80-c37b-455e-9294-547be2082f1c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.412540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f9e80-c37b-455e-9294-547be2082f1c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.457776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051cbed-d426-49d7-900d-0348d1bbcd55 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.465109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d219b-7547-49cf-a3de-01e548f0b3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.465938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d219b-7547-49cf-a3de-01e548f0b3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.466237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d219b-7547-49cf-a3de-01e548f0b3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.466553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d219b-7547-49cf-a3de-01e548f0b3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.467716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d219b-7547-49cf-a3de-01e548f0b3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.470018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d219b-7547-49cf-a3de-01e548f0b3c5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.472860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a0e8a-25df-468f-88a6-191c3dea7420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.473636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a0e8a-25df-468f-88a6-191c3dea7420 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.474000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a0e8a-25df-468f-88a6-191c3dea7420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.474279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a0e8a-25df-468f-88a6-191c3dea7420 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.475148 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a0e8a-25df-468f-88a6-191c3dea7420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.476741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a0e8a-25df-468f-88a6-191c3dea7420 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.488976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 795/1584] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.492864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a0e8a-25df-468f-88a6-191c3dea7420 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.496277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 790/1585] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.496277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d219b-7547-49cf-a3de-01e548f0b3c5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.506098 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a0e8a-25df-468f-88a6-191c3dea7420 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.508278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d219b-7547-49cf-a3de-01e548f0b3c5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.512056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdc9f7-3cf6-4de7-b9b4-3b0d82fffb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.512836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdc9f7-3cf6-4de7-b9b4-3b0d82fffb8c admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.513183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0845364-d62b-4c36-b5fc-5f2e4e485f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.513335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdc9f7-3cf6-4de7-b9b4-3b0d82fffb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.513462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdc9f7-3cf6-4de7-b9b4-3b0d82fffb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.513848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0845364-d62b-4c36-b5fc-5f2e4e485f07 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.514136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0845364-d62b-4c36-b5fc-5f2e4e485f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.514412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdc9f7-3cf6-4de7-b9b4-3b0d82fffb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.514519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0845364-d62b-4c36-b5fc-5f2e4e485f07 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.515234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0845364-d62b-4c36-b5fc-5f2e4e485f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.516279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdc9f7-3cf6-4de7-b9b4-3b0d82fffb8c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.518946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0845364-d62b-4c36-b5fc-5f2e4e485f07 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.532574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 796/1586] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.533389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdc9f7-3cf6-4de7-b9b4-3b0d82fffb8c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.549556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 791/1587] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/users => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.550801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0845364-d62b-4c36-b5fc-5f2e4e485f07 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.553987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdc9f7-3cf6-4de7-b9b4-3b0d82fffb8c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.561444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a23791-8456-44ed-bbf5-ba7eebdd0192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.562865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a23791-8456-44ed-bbf5-ba7eebdd0192 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.563149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0845364-d62b-4c36-b5fc-5f2e4e485f07 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.563274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a23791-8456-44ed-bbf5-ba7eebdd0192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.563574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a23791-8456-44ed-bbf5-ba7eebdd0192 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.564304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a23791-8456-44ed-bbf5-ba7eebdd0192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.566182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a23791-8456-44ed-bbf5-ba7eebdd0192 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.568657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5baae-40bb-45b3-a718-daa51480512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.569320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5baae-40bb-45b3-a718-daa51480512c admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.569658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5baae-40bb-45b3-a718-daa51480512c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.569942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5baae-40bb-45b3-a718-daa51480512c admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.570674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5baae-40bb-45b3-a718-daa51480512c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.572935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5baae-40bb-45b3-a718-daa51480512c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.581102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 797/1588] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.581102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a23791-8456-44ed-bbf5-ba7eebdd0192 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.591895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a23791-8456-44ed-bbf5-ba7eebdd0192 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.596909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133e5a3-a047-4af2-b88f-d97d69f05e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.597808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133e5a3-a047-4af2-b88f-d97d69f05e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.598092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133e5a3-a047-4af2-b88f-d97d69f05e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.598410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133e5a3-a047-4af2-b88f-d97d69f05e6f admin admin] PATH_INFO: `/v3/projects/5ca0770e6b7542ec8c8a783c5bd9f94f/users/c998dda1719b4949a4d3cde1451e9845/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.603636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 792/1589] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.603636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5baae-40bb-45b3-a718-daa51480512c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.605213 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:50.615439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5baae-40bb-45b3-a718-daa51480512c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.617835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133e5a3-a047-4af2-b88f-d97d69f05e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0770e6b7542ec8c8a783c5bd9f94f, user_id=c998dda1719b4949a4d3cde1451e9845, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.620301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c2257-ee7e-41b0-b919-7148acd50d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.620583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133e5a3-a047-4af2-b88f-d97d69f05e6f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.620965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c2257-ee7e-41b0-b919-7148acd50d53 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.621250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c2257-ee7e-41b0-b919-7148acd50d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.621520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c2257-ee7e-41b0-b919-7148acd50d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.622239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c2257-ee7e-41b0-b919-7148acd50d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.624195 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c2257-ee7e-41b0-b919-7148acd50d53 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.645192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 798/1590] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:50 2022] PUT /identity/v3/projects/5ca0770e6b7542ec8c8a783c5bd9f94f/users/c998dda1719b4949a4d3cde1451e9845/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:50.645192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133e5a3-a047-4af2-b88f-d97d69f05e6f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.645503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 793/1591] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.645503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c2257-ee7e-41b0-b919-7148acd50d53 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.656832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c2257-ee7e-41b0-b919-7148acd50d53 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.706653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:50.717535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133e5a3-a047-4af2-b88f-d97d69f05e6f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.722707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfea64b-e305-4c8e-89bb-880f25794b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.722898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c9164-dd63-4ac9-9338-2d4cb8cbd428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.723384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea64b-e305-4c8e-89bb-880f25794b1f admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.723611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c9164-dd63-4ac9-9338-2d4cb8cbd428 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.723725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea64b-e305-4c8e-89bb-880f25794b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.723934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea64b-e305-4c8e-89bb-880f25794b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.724059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c9164-dd63-4ac9-9338-2d4cb8cbd428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.724410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c9164-dd63-4ac9-9338-2d4cb8cbd428 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.724660 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfea64b-e305-4c8e-89bb-880f25794b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.725269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c9164-dd63-4ac9-9338-2d4cb8cbd428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.726268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfea64b-e305-4c8e-89bb-880f25794b1f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.727233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c9164-dd63-4ac9-9338-2d4cb8cbd428 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.738742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 794/1592] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.739780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 799/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.740473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfea64b-e305-4c8e-89bb-880f25794b1f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.742573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c9164-dd63-4ac9-9338-2d4cb8cbd428 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.751297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfea64b-e305-4c8e-89bb-880f25794b1f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.753762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c9164-dd63-4ac9-9338-2d4cb8cbd428 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.762557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a944c-b6fb-4631-bb2a-04f22a42d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.762557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a944c-b6fb-4631-bb2a-04f22a42d3ae admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.762557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a944c-b6fb-4631-bb2a-04f22a42d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.762557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a944c-b6fb-4631-bb2a-04f22a42d3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.762923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a944c-b6fb-4631-bb2a-04f22a42d3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.763015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cba53-5acf-4723-9d7f-e96248b0db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.763015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cba53-5acf-4723-9d7f-e96248b0db5a admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.763015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cba53-5acf-4723-9d7f-e96248b0db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.763251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a944c-b6fb-4631-bb2a-04f22a42d3ae admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.763336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cba53-5acf-4723-9d7f-e96248b0db5a admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.763336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cba53-5acf-4723-9d7f-e96248b0db5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.763336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cba53-5acf-4723-9d7f-e96248b0db5a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.774775 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 800/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.775899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a944c-b6fb-4631-bb2a-04f22a42d3ae admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.786391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a944c-b6fb-4631-bb2a-04f22a42d3ae admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.793043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b668-6cd7-462f-ab33-0b6e14803c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.793949 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b668-6cd7-462f-ab33-0b6e14803c1f admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.794333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b668-6cd7-462f-ab33-0b6e14803c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.794701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b668-6cd7-462f-ab33-0b6e14803c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.795583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b668-6cd7-462f-ab33-0b6e14803c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.797457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 795/1595] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.798501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cba53-5acf-4723-9d7f-e96248b0db5a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.801304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b668-6cd7-462f-ab33-0b6e14803c1f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.809309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cba53-5acf-4723-9d7f-e96248b0db5a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.814499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 801/1596] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.815279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d566fb4-5d98-4c80-a113-3e8dea62c44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.816218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d566fb4-5d98-4c80-a113-3e8dea62c44d admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.816501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d566fb4-5d98-4c80-a113-3e8dea62c44d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.816777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d566fb4-5d98-4c80-a113-3e8dea62c44d admin admin] PATH_INFO: `/v3/projects/11861d35a3444734be8870f47cce1b9b/users/b0b95c321c4a452faa81a93168c7bf0a/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.818899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffbe59-36a8-4171-86c6-d5aae91a0df0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.819111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffbe59-36a8-4171-86c6-d5aae91a0df0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.819379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffbe59-36a8-4171-86c6-d5aae91a0df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.836183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d566fb4-5d98-4c80-a113-3e8dea62c44d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11861d35a3444734be8870f47cce1b9b, user_id=b0b95c321c4a452faa81a93168c7bf0a, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.838904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d566fb4-5d98-4c80-a113-3e8dea62c44d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.859943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 796/1597] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:50 2022] PUT /identity/v3/projects/11861d35a3444734be8870f47cce1b9b/users/b0b95c321c4a452faa81a93168c7bf0a/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:50.859943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d566fb4-5d98-4c80-a113-3e8dea62c44d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.861430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d0ffbe59-36a8-4171-86c6-d5aae91a0df0 None None] MFA Rules not processed for user `c998dda1719b4949a4d3cde1451e9845`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:50.862995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d0ffbe59-36a8-4171-86c6-d5aae91a0df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:50.930633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d566fb4-5d98-4c80-a113-3e8dea62c44d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.935122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 802/1598] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:50.939394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2edb3-85b0-4f6d-b42e-6f24f87130bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.939394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2edb3-85b0-4f6d-b42e-6f24f87130bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.939394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2edb3-85b0-4f6d-b42e-6f24f87130bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.939394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2edb3-85b0-4f6d-b42e-6f24f87130bb admin admin] PATH_INFO: `/v3/projects/2123ff10502044b9aea48720440c2291/users/eb8df5670686403480cdfd32ac408945/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.940723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffbe59-36a8-4171-86c6-d5aae91a0df0 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.952385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffbe59-36a8-4171-86c6-d5aae91a0df0 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.955007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2edb3-85b0-4f6d-b42e-6f24f87130bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2123ff10502044b9aea48720440c2291, user_id=eb8df5670686403480cdfd32ac408945, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.958150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2edb3-85b0-4f6d-b42e-6f24f87130bb admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.959115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963083c-6754-4d8d-80dc-204429fdb71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.959805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963083c-6754-4d8d-80dc-204429fdb71d admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.960095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963083c-6754-4d8d-80dc-204429fdb71d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.960367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963083c-6754-4d8d-80dc-204429fdb71d admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.961091 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963083c-6754-4d8d-80dc-204429fdb71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.962803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963083c-6754-4d8d-80dc-204429fdb71d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.973461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 797/1599] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:50 2022] PUT /identity/v3/projects/2123ff10502044b9aea48720440c2291/users/eb8df5670686403480cdfd32ac408945/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:50.974256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2edb3-85b0-4f6d-b42e-6f24f87130bb admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.982348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 803/1600] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:50.983209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963083c-6754-4d8d-80dc-204429fdb71d admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.996751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963083c-6754-4d8d-80dc-204429fdb71d admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.032842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.040660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2edb3-85b0-4f6d-b42e-6f24f87130bb admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.045684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100b67d-4464-4f3b-800d-30c83734ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.047198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100b67d-4464-4f3b-800d-30c83734ab35 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.047440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100b67d-4464-4f3b-800d-30c83734ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.048039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100b67d-4464-4f3b-800d-30c83734ab35 admin admin] PATH_INFO: `/v3/projects/eacce04e67d14a2f8ae63f5cd115b69c/users/d230950f9e984a8b878d7d0f74dda3ce/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.063153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100b67d-4464-4f3b-800d-30c83734ab35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacce04e67d14a2f8ae63f5cd115b69c, user_id=d230950f9e984a8b878d7d0f74dda3ce, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.063313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe617df-a970-4ff1-ab90-af83cebd8452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.063826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe617df-a970-4ff1-ab90-af83cebd8452 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.064114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe617df-a970-4ff1-ab90-af83cebd8452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.064396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe617df-a970-4ff1-ab90-af83cebd8452 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.065130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe617df-a970-4ff1-ab90-af83cebd8452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.065920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100b67d-4464-4f3b-800d-30c83734ab35 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.066806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe617df-a970-4ff1-ab90-af83cebd8452 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.077457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 804/1601] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:51.078649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe617df-a970-4ff1-ab90-af83cebd8452 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.080602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 798/1602] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:50 2022] PUT /identity/v3/projects/eacce04e67d14a2f8ae63f5cd115b69c/users/d230950f9e984a8b878d7d0f74dda3ce/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:51.081755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8cfc-372c-4eb8-9009-755218edaaa5 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.082049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8cfc-372c-4eb8-9009-755218edaaa5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.082383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e8cfc-372c-4eb8-9009-755218edaaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.088782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe617df-a970-4ff1-ab90-af83cebd8452 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.101260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-9f0e8cfc-372c-4eb8-9009-755218edaaa5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:51.102534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9f0e8cfc-372c-4eb8-9009-755218edaaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.112047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.148586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fbc90-33da-4e67-a11c-65b789cb4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.149254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fbc90-33da-4e67-a11c-65b789cb4bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.149540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fbc90-33da-4e67-a11c-65b789cb4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.149821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fbc90-33da-4e67-a11c-65b789cb4bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.150607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fbc90-33da-4e67-a11c-65b789cb4bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.152260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fbc90-33da-4e67-a11c-65b789cb4bc4 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.162636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 805/1603] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:51.163409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fbc90-33da-4e67-a11c-65b789cb4bc4 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.168362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 799/1604] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:51.169744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358561-a7ae-4665-a6a0-1605be091b50 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.170155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358561-a7ae-4665-a6a0-1605be091b50 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.170571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358561-a7ae-4665-a6a0-1605be091b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.173831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fbc90-33da-4e67-a11c-65b789cb4bc4 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.178521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05be417-28bd-4e3e-8d8b-8e2ff776b3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.179251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05be417-28bd-4e3e-8d8b-8e2ff776b3ce admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.179483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05be417-28bd-4e3e-8d8b-8e2ff776b3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.179863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05be417-28bd-4e3e-8d8b-8e2ff776b3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.180590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05be417-28bd-4e3e-8d8b-8e2ff776b3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.182990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05be417-28bd-4e3e-8d8b-8e2ff776b3ce admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.191088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8a358561-a7ae-4665-a6a0-1605be091b50 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:51.192570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8a358561-a7ae-4665-a6a0-1605be091b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.200496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 800/1605] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:51.201320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a358561-a7ae-4665-a6a0-1605be091b50 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.211613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a358561-a7ae-4665-a6a0-1605be091b50 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.214631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 806/1606] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:51.215717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05be417-28bd-4e3e-8d8b-8e2ff776b3ce admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.219394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d250e-2d26-498c-8665-70ca0400fed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.220222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d250e-2d26-498c-8665-70ca0400fed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.220532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d250e-2d26-498c-8665-70ca0400fed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.220808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d250e-2d26-498c-8665-70ca0400fed5 admin admin] PATH_INFO: `/v3/projects/b14d176a6ae64d38905e5bd43c97c253/users/b982efb5297246ccbf6515cf7bc9dde5/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.235894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d250e-2d26-498c-8665-70ca0400fed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14d176a6ae64d38905e5bd43c97c253, user_id=b982efb5297246ccbf6515cf7bc9dde5, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.238634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d250e-2d26-498c-8665-70ca0400fed5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.253306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 801/1607] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:51 2022] PUT /identity/v3/projects/b14d176a6ae64d38905e5bd43c97c253/users/b982efb5297246ccbf6515cf7bc9dde5/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:51.254584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac759bc-0ecf-48b8-8639-28de5423c29b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.254876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac759bc-0ecf-48b8-8639-28de5423c29b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.255155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac759bc-0ecf-48b8-8639-28de5423c29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.272146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-fac759bc-0ecf-48b8-8639-28de5423c29b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:51.273343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-fac759bc-0ecf-48b8-8639-28de5423c29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.277398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05be417-28bd-4e3e-8d8b-8e2ff776b3ce admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.327588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.333185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 802/1608] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:51.335332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac759bc-0ecf-48b8-8639-28de5423c29b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.335831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4035c03-e9f7-4fce-a348-7a09405b15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.336874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4035c03-e9f7-4fce-a348-7a09405b15c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.337117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4035c03-e9f7-4fce-a348-7a09405b15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.337399 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4035c03-e9f7-4fce-a348-7a09405b15c6 admin admin] PATH_INFO: `/v3/projects/35949285b2344805a597b6c9842f47e8/users/c00c6a789b9742c08769e391656b3b72/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.345750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac759bc-0ecf-48b8-8639-28de5423c29b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.350962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d31ff7-c302-4a84-9ff5-cd984916418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.351856 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d31ff7-c302-4a84-9ff5-cd984916418f admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.352144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d31ff7-c302-4a84-9ff5-cd984916418f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.352432 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d31ff7-c302-4a84-9ff5-cd984916418f admin admin] PATH_INFO: `/v3/projects/43f9a4e53da6457a83ea4600c865fc50/users/be279191d67b41b488ef8862d16ba6cf/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.354922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4035c03-e9f7-4fce-a348-7a09405b15c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35949285b2344805a597b6c9842f47e8, user_id=c00c6a789b9742c08769e391656b3b72, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.357657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4035c03-e9f7-4fce-a348-7a09405b15c6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.368793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d31ff7-c302-4a84-9ff5-cd984916418f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f9a4e53da6457a83ea4600c865fc50, user_id=be279191d67b41b488ef8862d16ba6cf, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.371532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d31ff7-c302-4a84-9ff5-cd984916418f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.375023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 807/1609] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:51 2022] PUT /identity/v3/projects/35949285b2344805a597b6c9842f47e8/users/c00c6a789b9742c08769e391656b3b72/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:51.375900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4035c03-e9f7-4fce-a348-7a09405b15c6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.377645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b4035c03-e9f7-4fce-a348-7a09405b15c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.392792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 803/1610] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:51 2022] PUT /identity/v3/projects/43f9a4e53da6457a83ea4600c865fc50/users/be279191d67b41b488ef8862d16ba6cf/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:51.393748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d31ff7-c302-4a84-9ff5-cd984916418f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.395471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-68d31ff7-c302-4a84-9ff5-cd984916418f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.442019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4035c03-e9f7-4fce-a348-7a09405b15c6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.461125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d31ff7-c302-4a84-9ff5-cd984916418f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.464892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7e88-d777-4ad9-80ad-d8bd44506d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.465528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7e88-d777-4ad9-80ad-d8bd44506d0a service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.465816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7e88-d777-4ad9-80ad-d8bd44506d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.466093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7e88-d777-4ad9-80ad-d8bd44506d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.479564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.492586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d2843-3832-4c2b-9ba6-fe079f71bb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.493238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d2843-3832-4c2b-9ba6-fe079f71bb55 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.493524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d2843-3832-4c2b-9ba6-fe079f71bb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.493806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d2843-3832-4c2b-9ba6-fe079f71bb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.529401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7e88-d777-4ad9-80ad-d8bd44506d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.531669 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b7e88-d777-4ad9-80ad-d8bd44506d0a service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.543429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 804/1611] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:51.544127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7e88-d777-4ad9-80ad-d8bd44506d0a service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.554694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b7e88-d777-4ad9-80ad-d8bd44506d0a service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.559940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfae18-4aae-4043-a64a-e6d5a277d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.560183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d2843-3832-4c2b-9ba6-fe079f71bb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.560295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfae18-4aae-4043-a64a-e6d5a277d65f admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.560470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfae18-4aae-4043-a64a-e6d5a277d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.560732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfae18-4aae-4043-a64a-e6d5a277d65f admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.561722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfae18-4aae-4043-a64a-e6d5a277d65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.562061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d2843-3832-4c2b-9ba6-fe079f71bb55 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.565152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfae18-4aae-4043-a64a-e6d5a277d65f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.574710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 808/1612] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:51.576580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba9c86-271e-4ce0-b16f-c0aff10f2ffc None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.576990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba9c86-271e-4ce0-b16f-c0aff10f2ffc None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.577304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba9c86-271e-4ce0-b16f-c0aff10f2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.588331 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 805/1613] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:51.589486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfae18-4aae-4043-a64a-e6d5a277d65f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.598396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-42ba9c86-271e-4ce0-b16f-c0aff10f2ffc None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:51.600139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-42ba9c86-271e-4ce0-b16f-c0aff10f2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.600278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfae18-4aae-4043-a64a-e6d5a277d65f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.605150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36f09b-6902-4f8c-8606-9f0693f20db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.605839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36f09b-6902-4f8c-8606-9f0693f20db7 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.606342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36f09b-6902-4f8c-8606-9f0693f20db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.606726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36f09b-6902-4f8c-8606-9f0693f20db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.609657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 809/1614] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:51.613855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f864868-1f69-4d93-8cb2-78f0852aabe7 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.614147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f864868-1f69-4d93-8cb2-78f0852aabe7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.614464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f864868-1f69-4d93-8cb2-78f0852aabe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.618579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36f09b-6902-4f8c-8606-9f0693f20db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.620046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36f09b-6902-4f8c-8606-9f0693f20db7 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.634167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 806/1615] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:51.635609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ec17-aed7-44eb-a408-36e0317013b6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.635916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ec17-aed7-44eb-a408-36e0317013b6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.636321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ec17-aed7-44eb-a408-36e0317013b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.645882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8f864868-1f69-4d93-8cb2-78f0852aabe7 None None] MFA Rules not processed for user `c00c6a789b9742c08769e391656b3b72`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:51.647691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8f864868-1f69-4d93-8cb2-78f0852aabe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.667189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-17e1ec17-aed7-44eb-a408-36e0317013b6 None None] MFA Rules not processed for user `be279191d67b41b488ef8862d16ba6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:51.668510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-17e1ec17-aed7-44eb-a408-36e0317013b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.677597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.734342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 810/1616] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:51.735531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f864868-1f69-4d93-8cb2-78f0852aabe7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.757067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 807/1617] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:51.758289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1ec17-aed7-44eb-a408-36e0317013b6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.762060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f864868-1f69-4d93-8cb2-78f0852aabe7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.769115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5b1ff-6279-4c57-8fa8-17df416e3f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.770050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b1ff-6279-4c57-8fa8-17df416e3f14 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.770991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b1ff-6279-4c57-8fa8-17df416e3f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.771188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5b1ff-6279-4c57-8fa8-17df416e3f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.772532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5b1ff-6279-4c57-8fa8-17df416e3f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.774922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5b1ff-6279-4c57-8fa8-17df416e3f14 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.787591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1ec17-aed7-44eb-a408-36e0317013b6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.791746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 811/1618] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:51.794083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ca796-7f4b-49b2-8e20-f827d107a8ee None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.794083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ca796-7f4b-49b2-8e20-f827d107a8ee None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.794569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ca796-7f4b-49b2-8e20-f827d107a8ee None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.797255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 812/1619] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 23 10:49:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:51.798345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b403fd-b106-44da-99e8-61a6f31b291c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.798827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ca796-7f4b-49b2-8e20-f827d107a8ee None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.799096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b403fd-b106-44da-99e8-61a6f31b291c service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.799382 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b403fd-b106-44da-99e8-61a6f31b291c service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.799661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b403fd-b106-44da-99e8-61a6f31b291c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.818111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ca796-7f4b-49b2-8e20-f827d107a8ee None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.826199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2e75-ed5a-4f3f-a5bb-9717d301d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.827115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b403fd-b106-44da-99e8-61a6f31b291c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.827443 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2e75-ed5a-4f3f-a5bb-9717d301d3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.828453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2e75-ed5a-4f3f-a5bb-9717d301d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.828851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2e75-ed5a-4f3f-a5bb-9717d301d3b4 admin admin] PATH_INFO: `/v3/projects/3b377deedad8465eb8f1bd3afe7f6113/users/0dc5be5ddfd646b9bed1e95ee695a6fa/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.829465 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b403fd-b106-44da-99e8-61a6f31b291c service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.842059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 808/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:51.844919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71eb6d-bc63-4745-9881-a1b53fff348c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.845220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71eb6d-bc63-4745-9881-a1b53fff348c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.845506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71eb6d-bc63-4745-9881-a1b53fff348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.847876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc2e75-ed5a-4f3f-a5bb-9717d301d3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b377deedad8465eb8f1bd3afe7f6113, user_id=0dc5be5ddfd646b9bed1e95ee695a6fa, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.851688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc2e75-ed5a-4f3f-a5bb-9717d301d3b4 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.868903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0b71eb6d-bc63-4745-9881-a1b53fff348c None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:51.870257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0b71eb6d-bc63-4745-9881-a1b53fff348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:51.870752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 813/1621] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:51 2022] PUT /identity/v3/projects/3b377deedad8465eb8f1bd3afe7f6113/users/0dc5be5ddfd646b9bed1e95ee695a6fa/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:51.873071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f58c9-434c-499a-9d95-4de5ce1cb7e8 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.873510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f58c9-434c-499a-9d95-4de5ce1cb7e8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.874065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f58c9-434c-499a-9d95-4de5ce1cb7e8 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.882177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 814/1622] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jun 23 10:49:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:51.883198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f58c9-434c-499a-9d95-4de5ce1cb7e8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.944999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.991101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f58c9-434c-499a-9d95-4de5ce1cb7e8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:52.007201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 809/1623] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:52.008434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f26f6e-c80e-464f-9e01-d0d99d795e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:52.008877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff83834-eb68-45ed-8344-24a9b928fe02 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.009419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff83834-eb68-45ed-8344-24a9b928fe02 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.009713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff83834-eb68-45ed-8344-24a9b928fe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.012793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f26f6e-c80e-464f-9e01-d0d99d795e82 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.013076 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f26f6e-c80e-464f-9e01-d0d99d795e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.013405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f26f6e-c80e-464f-9e01-d0d99d795e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.016078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f26f6e-c80e-464f-9e01-d0d99d795e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:52.023813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f26f6e-c80e-464f-9e01-d0d99d795e82 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:52.035872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-bff83834-eb68-45ed-8344-24a9b928fe02 None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:52.037642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bff83834-eb68-45ed-8344-24a9b928fe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:52.048611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 815/1624] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:52.054592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f26f6e-c80e-464f-9e01-d0d99d795e82 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:52.057920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 810/1625] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jun 23 10:49:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:52.060143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff83834-eb68-45ed-8344-24a9b928fe02 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:52.074755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f26f6e-c80e-464f-9e01-d0d99d795e82 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:52.081510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e85f4-b240-4657-940f-6f6edb63c2f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:52.082307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e85f4-b240-4657-940f-6f6edb63c2f5 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.082726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e85f4-b240-4657-940f-6f6edb63c2f5 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.083336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e85f4-b240-4657-940f-6f6edb63c2f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.085595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff83834-eb68-45ed-8344-24a9b928fe02 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:52.095855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ceae9-dea9-473c-a0e9-49cdaea2cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:52.096902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ceae9-dea9-473c-a0e9-49cdaea2cc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.097662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ceae9-dea9-473c-a0e9-49cdaea2cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.097958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ceae9-dea9-473c-a0e9-49cdaea2cc9f admin admin] PATH_INFO: `/v3/projects/3b377deedad8465eb8f1bd3afe7f6113/users/0dc5be5ddfd646b9bed1e95ee695a6fa/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.100925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ceae9-dea9-473c-a0e9-49cdaea2cc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b377deedad8465eb8f1bd3afe7f6113, user_id=0dc5be5ddfd646b9bed1e95ee695a6fa, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:52.104526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ceae9-dea9-473c-a0e9-49cdaea2cc9f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:52.122531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 811/1626] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:52 2022] PUT /identity/v3/projects/3b377deedad8465eb8f1bd3afe7f6113/users/0dc5be5ddfd646b9bed1e95ee695a6fa/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:52.127877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ceae9-dea9-473c-a0e9-49cdaea2cc9f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:52.201859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e85f4-b240-4657-940f-6f6edb63c2f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:52.207310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e85f4-b240-4657-940f-6f6edb63c2f5 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:52.222752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 816/1627] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:52.224095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea7a36-f559-4104-a3b3-8ad7a8734cd3 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.224376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea7a36-f559-4104-a3b3-8ad7a8734cd3 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.224657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea7a36-f559-4104-a3b3-8ad7a8734cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.279823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-5eea7a36-f559-4104-a3b3-8ad7a8734cd3 None None] MFA Rules not processed for user `0dc5be5ddfd646b9bed1e95ee695a6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:52.281923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5eea7a36-f559-4104-a3b3-8ad7a8734cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:52.311457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ceae9-dea9-473c-a0e9-49cdaea2cc9f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:52.315613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:52.327300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522dbd1-6791-4689-9ca3-02f9aed19f94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:52.329417 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522dbd1-6791-4689-9ca3-02f9aed19f94 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.329809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522dbd1-6791-4689-9ca3-02f9aed19f94 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.330209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522dbd1-6791-4689-9ca3-02f9aed19f94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.396229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 817/1628] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:52.408049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea7a36-f559-4104-a3b3-8ad7a8734cd3 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:52.445664 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522dbd1-6791-4689-9ca3-02f9aed19f94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:52.447857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522dbd1-6791-4689-9ca3-02f9aed19f94 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:52.480675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 812/1629] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:52.545908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea7a36-f559-4104-a3b3-8ad7a8734cd3 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:52.554598 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210405a1-1dcd-425d-a8d5-58ec1cb6ec4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:52.556096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210405a1-1dcd-425d-a8d5-58ec1cb6ec4b service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.556584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210405a1-1dcd-425d-a8d5-58ec1cb6ec4b service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.557186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210405a1-1dcd-425d-a8d5-58ec1cb6ec4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.573478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210405a1-1dcd-425d-a8d5-58ec1cb6ec4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:52.576138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210405a1-1dcd-425d-a8d5-58ec1cb6ec4b service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:52.590489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 818/1630] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:49:52.721228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e843b-95ab-4cd5-96c7-7f68c5a597e9 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.721857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e843b-95ab-4cd5-96c7-7f68c5a597e9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.721857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e843b-95ab-4cd5-96c7-7f68c5a597e9 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.723222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 813/1631] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 23 10:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:52.747007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85504a81-b239-4ec8-a923-504b0ac0cab1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.747907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85504a81-b239-4ec8-a923-504b0ac0cab1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.748801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85504a81-b239-4ec8-a923-504b0ac0cab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.777872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e843b-95ab-4cd5-96c7-7f68c5a597e9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:52.781907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-85504a81-b239-4ec8-a923-504b0ac0cab1 None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:52.783193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-85504a81-b239-4ec8-a923-504b0ac0cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:52.799395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e843b-95ab-4cd5-96c7-7f68c5a597e9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:52.803714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37327-d3c2-4140-b2c3-f3847873a4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:52.804361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37327-d3c2-4140-b2c3-f3847873a4fc service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.804796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37327-d3c2-4140-b2c3-f3847873a4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.805080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f37327-d3c2-4140-b2c3-f3847873a4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.806832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 819/1632] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:49:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:49:52.811328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85504a81-b239-4ec8-a923-504b0ac0cab1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:52.822586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85504a81-b239-4ec8-a923-504b0ac0cab1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:52.827155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7de3c-290d-4dbd-abfe-f5bded0e3cac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:52.827962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7de3c-290d-4dbd-abfe-f5bded0e3cac service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.828619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7de3c-290d-4dbd-abfe-f5bded0e3cac service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.828619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7de3c-290d-4dbd-abfe-f5bded0e3cac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.841827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7de3c-290d-4dbd-abfe-f5bded0e3cac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:52.844706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7de3c-290d-4dbd-abfe-f5bded0e3cac service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:52.864288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 820/1633] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:52.875951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cc1de-b990-4560-be1e-d9bf269dcf76 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.877180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cc1de-b990-4560-be1e-d9bf269dcf76 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.877180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cc1de-b990-4560-be1e-d9bf269dcf76 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.883019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 821/1634] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 23 10:49:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:52.884707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4525-c908-4b9a-bdd5-8216276027ef None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.885189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4525-c908-4b9a-bdd5-8216276027ef None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.885709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a4525-c908-4b9a-bdd5-8216276027ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.926925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37327-d3c2-4140-b2c3-f3847873a4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:52.928730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f37327-d3c2-4140-b2c3-f3847873a4fc service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:52.928861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-308a4525-c908-4b9a-bdd5-8216276027ef None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:52.936617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-308a4525-c908-4b9a-bdd5-8216276027ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:52.952417 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 814/1635] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:52.968873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 822/1636] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:49:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:52.978579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37327-d3c2-4140-b2c3-f3847873a4fc service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:52.982835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:52.991492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f37327-d3c2-4140-b2c3-f3847873a4fc service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:52.999889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c479c58-bf96-49a7-a918-ac9ba275da1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:53.000659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c479c58-bf96-49a7-a918-ac9ba275da1a service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.000844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c479c58-bf96-49a7-a918-ac9ba275da1a service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.001128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c479c58-bf96-49a7-a918-ac9ba275da1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.022681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c479c58-bf96-49a7-a918-ac9ba275da1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:53.024292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c479c58-bf96-49a7-a918-ac9ba275da1a service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:53.039039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 815/1637] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:53.977651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4525-c908-4b9a-bdd5-8216276027ef None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.206163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a4525-c908-4b9a-bdd5-8216276027ef None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.221978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.223025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.223414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.223822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] PATH_INFO: `/v3/users/c00c6a789b9742c08769e391656b3b72` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.228945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00c6a789b9742c08769e391656b3b72)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.230100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: WARNING py.warnings [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:49:54.230100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: warnings.warn(msg) Jun 23 10:49:54.230100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: Jun 23 10:49:54.231622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.331483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.367677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00c6a789b9742c08769e391656b3b72'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:54.369341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00c6a789b9742c08769e391656b3b72'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:54.369341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00c6a789b9742c08769e391656b3b72'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:54.409257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00c6a789b9742c08769e391656b3b72'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:54.432823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00c6a789b9742c08769e391656b3b72'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:54.467096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 823/1638] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:49:53 2022] DELETE /identity/v3/users/c00c6a789b9742c08769e391656b3b72 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:54.472000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc91719-8651-4c37-b247-d656531be0d3 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.473072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc91719-8651-4c37-b247-d656531be0d3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.473562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc91719-8651-4c37-b247-d656531be0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.508588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-abc91719-8651-4c37-b247-d656531be0d3 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:54.510599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-abc91719-8651-4c37-b247-d656531be0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:54.667559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 816/1639] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:54.719510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.721365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:54.819713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241bfdf-c09b-454f-82d9-75d1db033ffb admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.829786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ba91f-2442-4881-842c-b6671f748e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.831549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba91f-2442-4881-842c-b6671f748e08 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.832121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba91f-2442-4881-842c-b6671f748e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.832729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba91f-2442-4881-842c-b6671f748e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.854747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ba91f-2442-4881-842c-b6671f748e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.857123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ba91f-2442-4881-842c-b6671f748e08 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.877865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 824/1640] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:55.668446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc91719-8651-4c37-b247-d656531be0d3 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.670905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-abc91719-8651-4c37-b247-d656531be0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:55.711623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc91719-8651-4c37-b247-d656531be0d3 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.729984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.731447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.731920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.732406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] PATH_INFO: `/v3/projects/35949285b2344805a597b6c9842f47e8` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.738495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35949285b2344805a597b6c9842f47e8)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.739931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: WARNING py.warnings [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 10:49:55.739931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: warnings.warn(msg) Jun 23 10:49:55.739931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: Jun 23 10:49:55.742341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.845548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35949285b2344805a597b6c9842f47e8', 'request_id': 'req-79db4ae5-542d-49a8-8365-4cc5a9394a54'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:55.862597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35949285b2344805a597b6c9842f47e8', 'request_id': 'req-79db4ae5-542d-49a8-8365-4cc5a9394a54'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:55.883368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35949285b2344805a597b6c9842f47e8', 'request_id': 'req-79db4ae5-542d-49a8-8365-4cc5a9394a54'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:55.923317 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] The token cache is being invalidate because project 35949285b2344805a597b6c9842f47e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:49:55.924152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:55.926879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-79db4ae5-542d-49a8-8365-4cc5a9394a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:55.929458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 817/1641] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:49:55 2022] DELETE /identity/v3/projects/35949285b2344805a597b6c9842f47e8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:55.934533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2089fa-5add-4cf9-9296-0c94a6168873 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.935163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2089fa-5add-4cf9-9296-0c94a6168873 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.935271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2089fa-5add-4cf9-9296-0c94a6168873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.987403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-5e2089fa-5add-4cf9-9296-0c94a6168873 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:55.992520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5e2089fa-5add-4cf9-9296-0c94a6168873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:56.105933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 825/1642] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:56.115025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc446fc9-3abf-4a9e-ab6e-9f8b9d7a4309 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.115322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc446fc9-3abf-4a9e-ab6e-9f8b9d7a4309 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.115628 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc446fc9-3abf-4a9e-ab6e-9f8b9d7a4309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.148399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-bc446fc9-3abf-4a9e-ab6e-9f8b9d7a4309 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:56.149660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bc446fc9-3abf-4a9e-ab6e-9f8b9d7a4309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:56.174456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 818/1643] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:56.174808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2089fa-5add-4cf9-9296-0c94a6168873 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.197499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2089fa-5add-4cf9-9296-0c94a6168873 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.206036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa7fa-508b-46ba-a1f6-f14c35a0973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.206782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa7fa-508b-46ba-a1f6-f14c35a0973f admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.221083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa7fa-508b-46ba-a1f6-f14c35a0973f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.221725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa7fa-508b-46ba-a1f6-f14c35a0973f admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.223036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baa7fa-508b-46ba-a1f6-f14c35a0973f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:56.223497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baa7fa-508b-46ba-a1f6-f14c35a0973f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.225677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baa7fa-508b-46ba-a1f6-f14c35a0973f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.263866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 826/1644] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:56.269248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc446fc9-3abf-4a9e-ab6e-9f8b9d7a4309 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.282441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc446fc9-3abf-4a9e-ab6e-9f8b9d7a4309 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.294738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc267f9-072b-4eb6-92c8-e47e707ae680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.297193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc267f9-072b-4eb6-92c8-e47e707ae680 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.297567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc267f9-072b-4eb6-92c8-e47e707ae680 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.298289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc267f9-072b-4eb6-92c8-e47e707ae680 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.300804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc267f9-072b-4eb6-92c8-e47e707ae680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.304313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc267f9-072b-4eb6-92c8-e47e707ae680 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.380573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 819/1645] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:56 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:56.384535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa7fa-508b-46ba-a1f6-f14c35a0973f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.410553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa7fa-508b-46ba-a1f6-f14c35a0973f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.461952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:56.498007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bba70-7f6d-4c9d-80d4-acf9a735c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.498896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bba70-7f6d-4c9d-80d4-acf9a735c545 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.499836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bba70-7f6d-4c9d-80d4-acf9a735c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.500248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bba70-7f6d-4c9d-80d4-acf9a735c545 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.501634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bba70-7f6d-4c9d-80d4-acf9a735c545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.504272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bba70-7f6d-4c9d-80d4-acf9a735c545 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.563885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 827/1646] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:56 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:49:56.567560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc267f9-072b-4eb6-92c8-e47e707ae680 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.585095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc267f9-072b-4eb6-92c8-e47e707ae680 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.599357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805ff2-1286-466b-989a-5ba2ed623152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.600425 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805ff2-1286-466b-989a-5ba2ed623152 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.601793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805ff2-1286-466b-989a-5ba2ed623152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.602557 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805ff2-1286-466b-989a-5ba2ed623152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.603809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab805ff2-1286-466b-989a-5ba2ed623152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.614474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab805ff2-1286-466b-989a-5ba2ed623152 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.634766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 820/1647] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:56.639067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bba70-7f6d-4c9d-80d4-acf9a735c545 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.665894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bba70-7f6d-4c9d-80d4-acf9a735c545 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.675836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc258c54-a164-4ade-98bb-975c60f6da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.676986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc258c54-a164-4ade-98bb-975c60f6da57 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.677724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc258c54-a164-4ade-98bb-975c60f6da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.678521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc258c54-a164-4ade-98bb-975c60f6da57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.679822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc258c54-a164-4ade-98bb-975c60f6da57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.681844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc258c54-a164-4ade-98bb-975c60f6da57 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.701578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 828/1648] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:56.706246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805ff2-1286-466b-989a-5ba2ed623152 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.721722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805ff2-1286-466b-989a-5ba2ed623152 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.731418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93132d86-1c2a-4fa6-87e4-8db45ce36bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.733265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93132d86-1c2a-4fa6-87e4-8db45ce36bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.734856 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93132d86-1c2a-4fa6-87e4-8db45ce36bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.735551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93132d86-1c2a-4fa6-87e4-8db45ce36bc5 admin admin] PATH_INFO: `/v3/projects/18c98c540c8049dcbd739c76a496b3f3/users/86ab412c1e2d4d679ae56f271c2d66f0/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.773407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93132d86-1c2a-4fa6-87e4-8db45ce36bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c98c540c8049dcbd739c76a496b3f3, user_id=86ab412c1e2d4d679ae56f271c2d66f0, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.777462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93132d86-1c2a-4fa6-87e4-8db45ce36bc5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.804269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 821/1649] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:56 2022] PUT /identity/v3/projects/18c98c540c8049dcbd739c76a496b3f3/users/86ab412c1e2d4d679ae56f271c2d66f0/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:56.816088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e1e4e-b268-4d61-9a9c-3588c686101d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.816542 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e1e4e-b268-4d61-9a9c-3588c686101d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.816935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e1e4e-b268-4d61-9a9c-3588c686101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.871655 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-153e1e4e-b268-4d61-9a9c-3588c686101d None None] MFA Rules not processed for user `86ab412c1e2d4d679ae56f271c2d66f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:56.873030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-153e1e4e-b268-4d61-9a9c-3588c686101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:56.940729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93132d86-1c2a-4fa6-87e4-8db45ce36bc5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.942660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-93132d86-1c2a-4fa6-87e4-8db45ce36bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:56.963596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.141703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93132d86-1c2a-4fa6-87e4-8db45ce36bc5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.148844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 829/1650] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:57.154642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e1e4e-b268-4d61-9a9c-3588c686101d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.169119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.173254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.173549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.174153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] PATH_INFO: `/v3/users/c998dda1719b4949a4d3cde1451e9845` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.177478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c998dda1719b4949a4d3cde1451e9845)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.181513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.231178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e1e4e-b268-4d61-9a9c-3588c686101d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.268616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd28a6-ad81-471a-bcaf-e9935a67bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.269225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd28a6-ad81-471a-bcaf-e9935a67bb88 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.269518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd28a6-ad81-471a-bcaf-e9935a67bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.269811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd28a6-ad81-471a-bcaf-e9935a67bb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.270554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd28a6-ad81-471a-bcaf-e9935a67bb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.272544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd28a6-ad81-471a-bcaf-e9935a67bb88 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.331837 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c998dda1719b4949a4d3cde1451e9845'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:57.334171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c998dda1719b4949a4d3cde1451e9845'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:57.357801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c998dda1719b4949a4d3cde1451e9845'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:57.367462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c998dda1719b4949a4d3cde1451e9845'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:57.371593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 830/1651] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:49:57 2022] POST /identity/v3/projects => generated 371 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:57.372559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd28a6-ad81-471a-bcaf-e9935a67bb88 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.375331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-accd28a6-ad81-471a-bcaf-e9935a67bb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:57.388670 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c998dda1719b4949a4d3cde1451e9845'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:57.404453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 822/1652] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:49:56 2022] DELETE /identity/v3/users/c998dda1719b4949a4d3cde1451e9845 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:57.407378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.409386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:57.601319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd28a6-ad81-471a-bcaf-e9935a67bb88 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.694813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606aa3c-9de0-42dd-b903-10c80de71b72 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.701276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958ab2a-51ac-43d3-885e-dbbf6ec649cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.702001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958ab2a-51ac-43d3-885e-dbbf6ec649cf admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.702298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958ab2a-51ac-43d3-885e-dbbf6ec649cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.703594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958ab2a-51ac-43d3-885e-dbbf6ec649cf admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.704314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958ab2a-51ac-43d3-885e-dbbf6ec649cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.706796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958ab2a-51ac-43d3-885e-dbbf6ec649cf admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.762963 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.863773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.864688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.864977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.865318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] PATH_INFO: `/v3/users/be279191d67b41b488ef8862d16ba6cf` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.875918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be279191d67b41b488ef8862d16ba6cf)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.878336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.887396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 823/1653] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:49:57 2022] POST /identity/v3/users => generated 292 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:57.888735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df124-0e20-46a6-9c83-1cff34075dab None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.889036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df124-0e20-46a6-9c83-1cff34075dab None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.889323 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df124-0e20-46a6-9c83-1cff34075dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.958889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-882df124-0e20-46a6-9c83-1cff34075dab None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:57.975272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-882df124-0e20-46a6-9c83-1cff34075dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:58.002882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 824/1654] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:58.004186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882df124-0e20-46a6-9c83-1cff34075dab None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.029135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882df124-0e20-46a6-9c83-1cff34075dab None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.046997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be279191d67b41b488ef8862d16ba6cf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:58.047797 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be279191d67b41b488ef8862d16ba6cf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:58.048752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be279191d67b41b488ef8862d16ba6cf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:58.051246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a575ea1-aa98-4539-a5ac-c1635a97cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.057190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a575ea1-aa98-4539-a5ac-c1635a97cdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.058999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a575ea1-aa98-4539-a5ac-c1635a97cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.059444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a575ea1-aa98-4539-a5ac-c1635a97cdb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.063386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a575ea1-aa98-4539-a5ac-c1635a97cdb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.065434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a575ea1-aa98-4539-a5ac-c1635a97cdb7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.083262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:58.097284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be279191d67b41b488ef8862d16ba6cf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:58.099724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 825/1655] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:58.100865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a575ea1-aa98-4539-a5ac-c1635a97cdb7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.108493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9a575ea1-aa98-4539-a5ac-c1635a97cdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:58.161137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be279191d67b41b488ef8862d16ba6cf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:49:58.223960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 831/1656] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:49:57 2022] DELETE /identity/v3/users/be279191d67b41b488ef8862d16ba6cf => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:58.226528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.230280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:58.280572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a575ea1-aa98-4539-a5ac-c1635a97cdb7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.439934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc76626-c250-426e-a0fb-0b58069829e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.443055 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc76626-c250-426e-a0fb-0b58069829e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.444693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc76626-c250-426e-a0fb-0b58069829e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.445571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc76626-c250-426e-a0fb-0b58069829e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.457845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-dbc76626-c250-426e-a0fb-0b58069829e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:58.517510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc76626-c250-426e-a0fb-0b58069829e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.517926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2b4d4-b6e5-451b-8de3-0668cd6f6fe9 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.519594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc76626-c250-426e-a0fb-0b58069829e9 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.544348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5f1e1-3586-41fc-963d-2bb06274d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.544729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f1e1-3586-41fc-963d-2bb06274d47a admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.545020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f1e1-3586-41fc-963d-2bb06274d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.545307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5f1e1-3586-41fc-963d-2bb06274d47a admin admin] PATH_INFO: `/v3/projects/73e267ed914844aaab919eb58c749883/users/be38b25cfd1949e48189c0ed1941c80d/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.550841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 826/1657] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:58.552599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d8a9-af05-462c-bc02-2f3bc5103360 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.565476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d8a9-af05-462c-bc02-2f3bc5103360 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.566744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d8a9-af05-462c-bc02-2f3bc5103360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.613233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-fe57d8a9-af05-462c-bc02-2f3bc5103360 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:58.616555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-fe57d8a9-af05-462c-bc02-2f3bc5103360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:58.637236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5f1e1-3586-41fc-963d-2bb06274d47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e267ed914844aaab919eb58c749883, user_id=be38b25cfd1949e48189c0ed1941c80d, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.641466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5f1e1-3586-41fc-963d-2bb06274d47a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.653645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 827/1658] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:49:58.672952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 832/1659] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:58 2022] PUT /identity/v3/projects/73e267ed914844aaab919eb58c749883/users/be38b25cfd1949e48189c0ed1941c80d/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:58.677045 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d8a9-af05-462c-bc02-2f3bc5103360 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.694378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d8a9-af05-462c-bc02-2f3bc5103360 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.807116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5f1e1-3586-41fc-963d-2bb06274d47a admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.875293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c0ef2-b8af-416c-9f1f-30b0e1ed6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.876222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c0ef2-b8af-416c-9f1f-30b0e1ed6290 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.876995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c0ef2-b8af-416c-9f1f-30b0e1ed6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.877387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c0ef2-b8af-416c-9f1f-30b0e1ed6290 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.878143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c0ef2-b8af-416c-9f1f-30b0e1ed6290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.879876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c0ef2-b8af-416c-9f1f-30b0e1ed6290 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.893040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 828/1660] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:49:58.904513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c0ef2-b8af-416c-9f1f-30b0e1ed6290 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.909471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:58.975827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c0ef2-b8af-416c-9f1f-30b0e1ed6290 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.978239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5f1e1-3586-41fc-963d-2bb06274d47a admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.988099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73731761-28ad-464f-a168-58d84341a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.989338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73731761-28ad-464f-a168-58d84341a05e admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.989914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adbc03-9b2c-4fa7-8a63-04f92ce5f90c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.990611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adbc03-9b2c-4fa7-8a63-04f92ce5f90c service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.990902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adbc03-9b2c-4fa7-8a63-04f92ce5f90c service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.991093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73731761-28ad-464f-a168-58d84341a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.991198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adbc03-9b2c-4fa7-8a63-04f92ce5f90c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.991543 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73731761-28ad-464f-a168-58d84341a05e admin admin] PATH_INFO: `/v3/projects/73e267ed914844aaab919eb58c749883/users/be38b25cfd1949e48189c0ed1941c80d/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.996651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73731761-28ad-464f-a168-58d84341a05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73e267ed914844aaab919eb58c749883, user_id=be38b25cfd1949e48189c0ed1941c80d, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:59.000207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73731761-28ad-464f-a168-58d84341a05e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:59.016923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adbc03-9b2c-4fa7-8a63-04f92ce5f90c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:59.018472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adbc03-9b2c-4fa7-8a63-04f92ce5f90c service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:59.033275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 829/1661] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:49:58 2022] PUT /identity/v3/projects/73e267ed914844aaab919eb58c749883/users/be38b25cfd1949e48189c0ed1941c80d/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:59.043236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a266337-0a29-4734-bac5-ae5e5a83eaa2 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.043743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a266337-0a29-4734-bac5-ae5e5a83eaa2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.044115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a266337-0a29-4734-bac5-ae5e5a83eaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.052868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 833/1662] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:49:59.117922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-5a266337-0a29-4734-bac5-ae5e5a83eaa2 None None] MFA Rules not processed for user `be38b25cfd1949e48189c0ed1941c80d`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:59.119792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5a266337-0a29-4734-bac5-ae5e5a83eaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:59.244363 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:59.393500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 830/1663] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:49:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:49:59.394675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adbc03-9b2c-4fa7-8a63-04f92ce5f90c service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:59.396244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-81adbc03-9b2c-4fa7-8a63-04f92ce5f90c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:59.694378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adbc03-9b2c-4fa7-8a63-04f92ce5f90c service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:59.968939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde46c06-6d5c-4e05-949f-11f4583c343b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:59.973961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46c06-6d5c-4e05-949f-11f4583c343b service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.974275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46c06-6d5c-4e05-949f-11f4583c343b service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.975945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde46c06-6d5c-4e05-949f-11f4583c343b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.014161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde46c06-6d5c-4e05-949f-11f4583c343b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:00.016291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde46c06-6d5c-4e05-949f-11f4583c343b service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:00.060320 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 834/1664] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:49:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:50:00.899992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a266337-0a29-4734-bac5-ae5e5a83eaa2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.962193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde46c06-6d5c-4e05-949f-11f4583c343b service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.963951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-dde46c06-6d5c-4e05-949f-11f4583c343b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:01.081960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a266337-0a29-4734-bac5-ae5e5a83eaa2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.089837 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.106232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.107366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.108412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] PATH_INFO: `/v3/users/86ab412c1e2d4d679ae56f271c2d66f0` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.115509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ab412c1e2d4d679ae56f271c2d66f0)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.119228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.127677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde46c06-6d5c-4e05-949f-11f4583c343b service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.135714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.136801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.137228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.137670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] PATH_INFO: `/v3/projects/5ca0770e6b7542ec8c8a783c5bd9f94f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.139264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca0770e6b7542ec8c8a783c5bd9f94f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.143577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.221503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ab412c1e2d4d679ae56f271c2d66f0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.223011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ab412c1e2d4d679ae56f271c2d66f0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.259321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ab412c1e2d4d679ae56f271c2d66f0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.300849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:01.302000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ab412c1e2d4d679ae56f271c2d66f0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.320090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-59aec2ec-c3c6-46e7-8216-fed4df8809d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ab412c1e2d4d679ae56f271c2d66f0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.332996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 831/1665] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:00 2022] DELETE /identity/v3/users/86ab412c1e2d4d679ae56f271c2d66f0 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:01.344470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fbeb7-82c6-474d-a4bb-97bf29263513 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.344876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fbeb7-82c6-474d-a4bb-97bf29263513 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.345651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fbeb7-82c6-474d-a4bb-97bf29263513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.356151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca0770e6b7542ec8c8a783c5bd9f94f', 'request_id': 'req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.378816 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca0770e6b7542ec8c8a783c5bd9f94f', 'request_id': 'req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.398367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca0770e6b7542ec8c8a783c5bd9f94f', 'request_id': 'req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.408977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-cd7fbeb7-82c6-474d-a4bb-97bf29263513 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:01.415383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-cd7fbeb7-82c6-474d-a4bb-97bf29263513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:01.444842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] The token cache is being invalidate because project 5ca0770e6b7542ec8c8a783c5bd9f94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:01.450866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.452861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.470682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 835/1666] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:00 2022] DELETE /identity/v3/projects/5ca0770e6b7542ec8c8a783c5bd9f94f => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:01.475583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.487146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:01.516517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:01.587570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 832/1667] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:01.695992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fbeb7-82c6-474d-a4bb-97bf29263513 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.701036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-cd7fbeb7-82c6-474d-a4bb-97bf29263513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:01.725555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb264-ac46-4f5c-a48c-2bbe61ff13c0 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.731742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.733456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.734859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.735160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] PATH_INFO: `/v3/users/0dc5be5ddfd646b9bed1e95ee695a6fa` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.738217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc5be5ddfd646b9bed1e95ee695a6fa)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.742882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.845270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc5be5ddfd646b9bed1e95ee695a6fa'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.846074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc5be5ddfd646b9bed1e95ee695a6fa'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.849501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc5be5ddfd646b9bed1e95ee695a6fa'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.873475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc5be5ddfd646b9bed1e95ee695a6fa'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.899401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc5be5ddfd646b9bed1e95ee695a6fa'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:01.912961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fbeb7-82c6-474d-a4bb-97bf29263513 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.918936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.919904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.926665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.929476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.932309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 836/1668] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:01 2022] DELETE /identity/v3/users/0dc5be5ddfd646b9bed1e95ee695a6fa => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:01.937828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:01.976562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.981378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.020453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 833/1669] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:02.918299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.920644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:03.035872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.101851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c959d2-16bd-4dad-a1fb-e461d714cf9f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.113512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.115102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.119564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.120262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] PATH_INFO: `/v3/projects/43f9a4e53da6457a83ea4600c865fc50` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.122345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f9a4e53da6457a83ea4600c865fc50)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.126062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.229228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f9a4e53da6457a83ea4600c865fc50', 'request_id': 'req-be94f415-c993-475c-82b9-7b2b44cc9116'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.250763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f9a4e53da6457a83ea4600c865fc50', 'request_id': 'req-be94f415-c993-475c-82b9-7b2b44cc9116'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.262278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.263163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f9a4e53da6457a83ea4600c865fc50', 'request_id': 'req-be94f415-c993-475c-82b9-7b2b44cc9116'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.263810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:03.286544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b6d72-919e-46b3-a7a6-670790a3627d service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.289616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] The token cache is being invalidate because project 43f9a4e53da6457a83ea4600c865fc50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:03.290104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.290929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-be94f415-c993-475c-82b9-7b2b44cc9116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.295244 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 837/1670] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:02 2022] DELETE /identity/v3/projects/43f9a4e53da6457a83ea4600c865fc50 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:03.300707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ecf1-4d5a-452b-a0f6-97f7d8b0c60f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.301050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ecf1-4d5a-452b-a0f6-97f7d8b0c60f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.301398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ecf1-4d5a-452b-a0f6-97f7d8b0c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.347380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-7c81ecf1-4d5a-452b-a0f6-97f7d8b0c60f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:03.355238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7c81ecf1-4d5a-452b-a0f6-97f7d8b0c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:03.422527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.423380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.423652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.424090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] PATH_INFO: `/v3/projects/18c98c540c8049dcbd739c76a496b3f3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.425510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c98c540c8049dcbd739c76a496b3f3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.430077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.497693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 838/1671] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:03.500670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bd993-5947-4482-8033-c197a11cc60b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.501646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bd993-5947-4482-8033-c197a11cc60b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.501646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0bd993-5947-4482-8033-c197a11cc60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.546537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-fe0bd993-5947-4482-8033-c197a11cc60b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:03.548929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c98c540c8049dcbd739c76a496b3f3', 'request_id': 'req-da46bb19-9008-4544-835d-944534cf29ad'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.550348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-fe0bd993-5947-4482-8033-c197a11cc60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:03.566918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c98c540c8049dcbd739c76a496b3f3', 'request_id': 'req-da46bb19-9008-4544-835d-944534cf29ad'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.583050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c98c540c8049dcbd739c76a496b3f3', 'request_id': 'req-da46bb19-9008-4544-835d-944534cf29ad'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.615418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] The token cache is being invalidate because project 18c98c540c8049dcbd739c76a496b3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:03.615718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.619475 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.626655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 834/1672] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:03 2022] DELETE /identity/v3/projects/18c98c540c8049dcbd739c76a496b3f3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:50:03.631842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.633857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:03.684064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.715448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 839/1673] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:03.721468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bd993-5947-4482-8033-c197a11cc60b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.743531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0bd993-5947-4482-8033-c197a11cc60b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.754469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78da478-4e7e-4b52-a366-7ec8f6937168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.755151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78da478-4e7e-4b52-a366-7ec8f6937168 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.755437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78da478-4e7e-4b52-a366-7ec8f6937168 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.755706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78da478-4e7e-4b52-a366-7ec8f6937168 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.756452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78da478-4e7e-4b52-a366-7ec8f6937168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:03.756744 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78da478-4e7e-4b52-a366-7ec8f6937168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.758406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78da478-4e7e-4b52-a366-7ec8f6937168 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.796151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46bb19-9008-4544-835d-944534cf29ad admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.800714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 840/1674] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:03.801502 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.801757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78da478-4e7e-4b52-a366-7ec8f6937168 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.802469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.802754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.803034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] PATH_INFO: `/v3/users/be38b25cfd1949e48189c0ed1941c80d` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.807601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be38b25cfd1949e48189c0ed1941c80d)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.814500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.819220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.831185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78da478-4e7e-4b52-a366-7ec8f6937168 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.847858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea385c-9936-4208-92d7-74c6f75057a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.848531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea385c-9936-4208-92d7-74c6f75057a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.848821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea385c-9936-4208-92d7-74c6f75057a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.849096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea385c-9936-4208-92d7-74c6f75057a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.849798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea385c-9936-4208-92d7-74c6f75057a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.851753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea385c-9936-4208-92d7-74c6f75057a5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.912050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 841/1675] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:03 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:03.916507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea385c-9936-4208-92d7-74c6f75057a5 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.933851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be38b25cfd1949e48189c0ed1941c80d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.934720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be38b25cfd1949e48189c0ed1941c80d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.952307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be38b25cfd1949e48189c0ed1941c80d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.966821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be38b25cfd1949e48189c0ed1941c80d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.985151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be38b25cfd1949e48189c0ed1941c80d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:03.994101 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 835/1676] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:03 2022] DELETE /identity/v3/users/be38b25cfd1949e48189c0ed1941c80d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:04.042551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.044344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:04.092466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea385c-9936-4208-92d7-74c6f75057a5 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.194932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f0277-1681-4b4b-a922-4f4e821e16d7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.206932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.209651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.209954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.210240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] PATH_INFO: `/v3/users/1a583c5ef55a46788a2f5d3088922e3a` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.213710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a583c5ef55a46788a2f5d3088922e3a)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.231676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.261249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc9eb5-2f13-49f8-8695-b6ebc54cc375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.264200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc9eb5-2f13-49f8-8695-b6ebc54cc375 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.264200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc9eb5-2f13-49f8-8695-b6ebc54cc375 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.264674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc9eb5-2f13-49f8-8695-b6ebc54cc375 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.266205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc9eb5-2f13-49f8-8695-b6ebc54cc375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.284170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc9eb5-2f13-49f8-8695-b6ebc54cc375 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.327779 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.329114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 842/1677] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:03 2022] POST /identity/v3/users => generated 288 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:04.333607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc9eb5-2f13-49f8-8695-b6ebc54cc375 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.335247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3cfc9eb5-2f13-49f8-8695-b6ebc54cc375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:04.356101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc9eb5-2f13-49f8-8695-b6ebc54cc375 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.364825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e544482-fbcf-48be-99dc-795188cf9498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.365780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544482-fbcf-48be-99dc-795188cf9498 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.366179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544482-fbcf-48be-99dc-795188cf9498 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.366584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e544482-fbcf-48be-99dc-795188cf9498 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.368204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a583c5ef55a46788a2f5d3088922e3a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:04.370210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a583c5ef55a46788a2f5d3088922e3a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:04.370422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e544482-fbcf-48be-99dc-795188cf9498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.377747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e544482-fbcf-48be-99dc-795188cf9498 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.409725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 843/1678] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:50:04.412350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e544482-fbcf-48be-99dc-795188cf9498 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.414728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6e544482-fbcf-48be-99dc-795188cf9498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:04.418343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a583c5ef55a46788a2f5d3088922e3a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:04.438211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a583c5ef55a46788a2f5d3088922e3a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:04.445810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e544482-fbcf-48be-99dc-795188cf9498 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.452188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49c2b5-25f7-4af5-98b4-590cdecd7d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.453097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49c2b5-25f7-4af5-98b4-590cdecd7d9e admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.453585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49c2b5-25f7-4af5-98b4-590cdecd7d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.453973 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49c2b5-25f7-4af5-98b4-590cdecd7d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.454992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49c2b5-25f7-4af5-98b4-590cdecd7d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.457177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49c2b5-25f7-4af5-98b4-590cdecd7d9e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.459151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-55860bd3-f658-45ca-b479-492d8e47c2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a583c5ef55a46788a2f5d3088922e3a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:04.467646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 836/1679] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:04 2022] DELETE /identity/v3/users/1a583c5ef55a46788a2f5d3088922e3a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:50:04.472429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae02edf-88a0-4948-ab48-f662c77a2c96 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.472748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae02edf-88a0-4948-ab48-f662c77a2c96 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.473029 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae02edf-88a0-4948-ab48-f662c77a2c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.478948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 844/1680] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:04.487425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49c2b5-25f7-4af5-98b4-590cdecd7d9e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.508945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49c2b5-25f7-4af5-98b4-590cdecd7d9e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.516031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-2ae02edf-88a0-4948-ab48-f662c77a2c96 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:04.518293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2ae02edf-88a0-4948-ab48-f662c77a2c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:04.620469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.633766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69504-0ab5-4d8f-83be-c19f7c7c9eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.634804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69504-0ab5-4d8f-83be-c19f7c7c9eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.635312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69504-0ab5-4d8f-83be-c19f7c7c9eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.635603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed69504-0ab5-4d8f-83be-c19f7c7c9eb0 admin admin] PATH_INFO: `/v3/projects/60ac3465eaa142b78c8b4f08da777e0d/users/4c353419914a416da0682b5b77724ae1/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.659131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed69504-0ab5-4d8f-83be-c19f7c7c9eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ac3465eaa142b78c8b4f08da777e0d, user_id=4c353419914a416da0682b5b77724ae1, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.662100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 837/1681] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:04.664340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed69504-0ab5-4d8f-83be-c19f7c7c9eb0 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.689014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 845/1682] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:04 2022] PUT /identity/v3/projects/60ac3465eaa142b78c8b4f08da777e0d/users/4c353419914a416da0682b5b77724ae1/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:04.702374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644c2b-abe3-4d90-9375-c4978835afde None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.703341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644c2b-abe3-4d90-9375-c4978835afde None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.703638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a644c2b-abe3-4d90-9375-c4978835afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.760810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69504-0ab5-4d8f-83be-c19f7c7c9eb0 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.765349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-2a644c2b-abe3-4d90-9375-c4978835afde None None] MFA Rules not processed for user `4c353419914a416da0682b5b77724ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:04.767345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-1ed69504-0ab5-4d8f-83be-c19f7c7c9eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:04.767742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2a644c2b-abe3-4d90-9375-c4978835afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:04.940235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed69504-0ab5-4d8f-83be-c19f7c7c9eb0 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.952014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4cd9a-139a-4ee3-987f-8a1cbd4544f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.953393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4cd9a-139a-4ee3-987f-8a1cbd4544f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.953793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4cd9a-139a-4ee3-987f-8a1cbd4544f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.954164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4cd9a-139a-4ee3-987f-8a1cbd4544f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.958889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 838/1683] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:04.963176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644c2b-abe3-4d90-9375-c4978835afde None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.070702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:05.091983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4cd9a-139a-4ee3-987f-8a1cbd4544f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.095506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4cd9a-139a-4ee3-987f-8a1cbd4544f8 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.112864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 846/1684] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:05.115730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a644c2b-abe3-4d90-9375-c4978835afde None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.120793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29743f8-0bf2-4500-be39-eed7f27c8709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.121730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29743f8-0bf2-4500-be39-eed7f27c8709 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.122111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29743f8-0bf2-4500-be39-eed7f27c8709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.122537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29743f8-0bf2-4500-be39-eed7f27c8709 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.124133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29743f8-0bf2-4500-be39-eed7f27c8709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.127123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29743f8-0bf2-4500-be39-eed7f27c8709 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.160354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 839/1685] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:04 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:50:05.164368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4cd9a-139a-4ee3-987f-8a1cbd4544f8 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.178363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4cd9a-139a-4ee3-987f-8a1cbd4544f8 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.260999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5969f69-ba99-4153-b4bb-43a9cef12cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.261820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5969f69-ba99-4153-b4bb-43a9cef12cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.262245 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5969f69-ba99-4153-b4bb-43a9cef12cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.262804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5969f69-ba99-4153-b4bb-43a9cef12cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.264031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5969f69-ba99-4153-b4bb-43a9cef12cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.266663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5969f69-ba99-4153-b4bb-43a9cef12cf2 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.301349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 847/1686] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:05 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:05.305033 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29743f8-0bf2-4500-be39-eed7f27c8709 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.316669 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29743f8-0bf2-4500-be39-eed7f27c8709 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.324754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e6205-1652-4bba-ba10-2f62e65b3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.326925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e6205-1652-4bba-ba10-2f62e65b3946 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.327564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e6205-1652-4bba-ba10-2f62e65b3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.327957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e6205-1652-4bba-ba10-2f62e65b3946 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.329005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e6205-1652-4bba-ba10-2f62e65b3946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.332074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e6205-1652-4bba-ba10-2f62e65b3946 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.390903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 840/1687] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:05.396562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5969f69-ba99-4153-b4bb-43a9cef12cf2 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.417660 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5969f69-ba99-4153-b4bb-43a9cef12cf2 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.425715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a1a7-5c4a-4936-a599-8fa6d7030354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.426825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a1a7-5c4a-4936-a599-8fa6d7030354 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.427168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a1a7-5c4a-4936-a599-8fa6d7030354 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.427464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a1a7-5c4a-4936-a599-8fa6d7030354 admin admin] PATH_INFO: `/v3/projects/b99c0187474f4925b7c0133b10ab3701/users/5fb99d1ea4b94faab2ae475f8f76a44b/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.450737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7a1a7-5c4a-4936-a599-8fa6d7030354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99c0187474f4925b7c0133b10ab3701, user_id=5fb99d1ea4b94faab2ae475f8f76a44b, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.457520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7a1a7-5c4a-4936-a599-8fa6d7030354 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.462122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:05.484492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 848/1688] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:05 2022] PUT /identity/v3/projects/b99c0187474f4925b7c0133b10ab3701/users/5fb99d1ea4b94faab2ae475f8f76a44b/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:05.488733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e6205-1652-4bba-ba10-2f62e65b3946 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.506766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e6205-1652-4bba-ba10-2f62e65b3946 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.522453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a1a7-5c4a-4936-a599-8fa6d7030354 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.524944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2eb7a1a7-5c4a-4936-a599-8fa6d7030354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:05.616245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47585-72cb-45f2-9cbb-ee0d4e716b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.617626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47585-72cb-45f2-9cbb-ee0d4e716b16 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.617972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47585-72cb-45f2-9cbb-ee0d4e716b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.618456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc47585-72cb-45f2-9cbb-ee0d4e716b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.619412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47585-72cb-45f2-9cbb-ee0d4e716b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.621563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc47585-72cb-45f2-9cbb-ee0d4e716b16 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.640842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 841/1689] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:05.642841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47585-72cb-45f2-9cbb-ee0d4e716b16 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.658012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a1a7-5c4a-4936-a599-8fa6d7030354 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.666575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.667545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc47585-72cb-45f2-9cbb-ee0d4e716b16 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.668268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.668699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.669324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] PATH_INFO: `/v3/projects/3b377deedad8465eb8f1bd3afe7f6113` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.670615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b377deedad8465eb8f1bd3afe7f6113)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.675117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.679287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337448a-11aa-4b77-9173-7087bba164a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.680709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337448a-11aa-4b77-9173-7087bba164a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.681188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337448a-11aa-4b77-9173-7087bba164a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.681657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337448a-11aa-4b77-9173-7087bba164a9 admin admin] PATH_INFO: `/v3/projects/b99c0187474f4925b7c0133b10ab3701/users/5fb99d1ea4b94faab2ae475f8f76a44b/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.684606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337448a-11aa-4b77-9173-7087bba164a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99c0187474f4925b7c0133b10ab3701, user_id=5fb99d1ea4b94faab2ae475f8f76a44b, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.689491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8337448a-11aa-4b77-9173-7087bba164a9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.713078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 842/1690] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:05 2022] PUT /identity/v3/projects/b99c0187474f4925b7c0133b10ab3701/users/5fb99d1ea4b94faab2ae475f8f76a44b/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:05.715116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876119f-269b-4cbc-837d-530d7383cc6c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.715818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876119f-269b-4cbc-837d-530d7383cc6c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.716310 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876119f-269b-4cbc-837d-530d7383cc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.757419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b876119f-269b-4cbc-837d-530d7383cc6c None None] MFA Rules not processed for user `5fb99d1ea4b94faab2ae475f8f76a44b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:05.759515 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b876119f-269b-4cbc-837d-530d7383cc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:05.812824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b377deedad8465eb8f1bd3afe7f6113', 'request_id': 'req-7ad38949-fc52-4c7c-9607-69e3e784b173'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:05.831904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b377deedad8465eb8f1bd3afe7f6113', 'request_id': 'req-7ad38949-fc52-4c7c-9607-69e3e784b173'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:05.849119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b377deedad8465eb8f1bd3afe7f6113', 'request_id': 'req-7ad38949-fc52-4c7c-9607-69e3e784b173'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:05.876872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] The token cache is being invalidate because project 3b377deedad8465eb8f1bd3afe7f6113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:05.877009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:05.878268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ad38949-fc52-4c7c-9607-69e3e784b173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:05.882243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 849/1691] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:05 2022] DELETE /identity/v3/projects/3b377deedad8465eb8f1bd3afe7f6113 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:05.887015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a7c9-6df8-4a2e-9a8c-1002ba31cce0 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.888787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a7c9-6df8-4a2e-9a8c-1002ba31cce0 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.889526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a7c9-6df8-4a2e-9a8c-1002ba31cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.928520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 843/1692] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:05.932458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d6c2a7c9-6df8-4a2e-9a8c-1002ba31cce0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:05.933695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d6c2a7c9-6df8-4a2e-9a8c-1002ba31cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:05.936652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876119f-269b-4cbc-837d-530d7383cc6c None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.938868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b876119f-269b-4cbc-837d-530d7383cc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:05.999758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:06.050169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876119f-269b-4cbc-837d-530d7383cc6c None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.052224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 850/1693] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:06.060451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d5531-5969-4972-81df-233e56c5109e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.060741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d5531-5969-4972-81df-233e56c5109e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.061027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d5531-5969-4972-81df-233e56c5109e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.084072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.085111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.085618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.086092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.088386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:06.115751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-611d5531-5969-4972-81df-233e56c5109e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:06.117246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-611d5531-5969-4972-81df-233e56c5109e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:06.145152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 851/1694] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:06.147204 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d5531-5969-4972-81df-233e56c5109e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.181927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d5531-5969-4972-81df-233e56c5109e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.211664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af2b1d-cb6d-4ee5-8413-90fc9d30aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.212788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af2b1d-cb6d-4ee5-8413-90fc9d30aa4d admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.213783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af2b1d-cb6d-4ee5-8413-90fc9d30aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.214241 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af2b1d-cb6d-4ee5-8413-90fc9d30aa4d admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.216673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af2b1d-cb6d-4ee5-8413-90fc9d30aa4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:06.218299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af2b1d-cb6d-4ee5-8413-90fc9d30aa4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.222919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af2b1d-cb6d-4ee5-8413-90fc9d30aa4d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.244348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.245838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.265468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 852/1695] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:06.265468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049373-b242-467f-8767-1d967e9faab4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.265468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049373-b242-467f-8767-1d967e9faab4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.265997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f049373-b242-467f-8767-1d967e9faab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.277755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:06.281550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 844/1696] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:50:06.282536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.291212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:06.317938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-1f049373-b242-467f-8767-1d967e9faab4 None None] MFA Rules not processed for user `b0b95c321c4a452faa81a93168c7bf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:06.320514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-1f049373-b242-467f-8767-1d967e9faab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:06.334834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47acaa-8cb7-418a-88b5-74301883c2a9 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.354183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.355091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.355381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.355663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] PATH_INFO: `/v3/projects/73e267ed914844aaab919eb58c749883` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.357265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=73e267ed914844aaab919eb58c749883)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.359588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.475080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73e267ed914844aaab919eb58c749883', 'request_id': 'req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:06.493729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 853/1697] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:06.494014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73e267ed914844aaab919eb58c749883', 'request_id': 'req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:06.495458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f049373-b242-467f-8767-1d967e9faab4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.504888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73e267ed914844aaab919eb58c749883', 'request_id': 'req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:06.540504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] The token cache is being invalidate because project 73e267ed914844aaab919eb58c749883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:06.543458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:06.545534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:06.547053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f049373-b242-467f-8767-1d967e9faab4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.557633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 845/1698] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:06 2022] DELETE /identity/v3/projects/73e267ed914844aaab919eb58c749883 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:06.566236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.568046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:06.784451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04216201-f22c-41c8-b3bd-182d30b8c483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.795555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04216201-f22c-41c8-b3bd-182d30b8c483 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.796960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04216201-f22c-41c8-b3bd-182d30b8c483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.797495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04216201-f22c-41c8-b3bd-182d30b8c483 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.798538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04216201-f22c-41c8-b3bd-182d30b8c483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.801288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04216201-f22c-41c8-b3bd-182d30b8c483 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.804119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:06.860113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b040e0-f9d9-4eb0-975c-6e99c5e3d28a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.881789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.882553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.882825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.883122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.894078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:06.914942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 854/1699] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:06 2022] POST /identity/v3/projects => generated 409 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:06.922692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb3cf3-e8fb-433c-9f58-3a716dd8e05e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.923070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb3cf3-e8fb-433c-9f58-3a716dd8e05e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.925457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb3cf3-e8fb-433c-9f58-3a716dd8e05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.996622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a3cb3cf3-e8fb-433c-9f58-3a716dd8e05e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:07.004895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a3cb3cf3-e8fb-433c-9f58-3a716dd8e05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:07.090371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.092013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.138495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 846/1700] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:07.139762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.146403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:07.159382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 855/1701] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:07.168496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd37ed-1893-419d-9652-73de83db5913 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.168795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd37ed-1893-419d-9652-73de83db5913 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.169072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd37ed-1893-419d-9652-73de83db5913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.198363 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4167b6-8477-4fc3-b245-2364a6b84f2e service nova] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.209659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e0cd37ed-1893-419d-9652-73de83db5913 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:07.213491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e0cd37ed-1893-419d-9652-73de83db5913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:07.215262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f814ad9-98e6-453b-9005-556522cc9627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.215956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f814ad9-98e6-453b-9005-556522cc9627 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.216244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f814ad9-98e6-453b-9005-556522cc9627 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.216524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f814ad9-98e6-453b-9005-556522cc9627 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.220434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f814ad9-98e6-453b-9005-556522cc9627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.222553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f814ad9-98e6-453b-9005-556522cc9627 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.233062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 856/1702] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:07.238479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd37ed-1893-419d-9652-73de83db5913 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.259224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd37ed-1893-419d-9652-73de83db5913 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.267193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214b61-4cad-466f-ab25-09aab8d1d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.267889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214b61-4cad-466f-ab25-09aab8d1d4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.268179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214b61-4cad-466f-ab25-09aab8d1d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.268465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b214b61-4cad-466f-ab25-09aab8d1d4e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.269209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214b61-4cad-466f-ab25-09aab8d1d4e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:07.269525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214b61-4cad-466f-ab25-09aab8d1d4e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.271266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b214b61-4cad-466f-ab25-09aab8d1d4e6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.290564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 847/1703] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:07 2022] POST /identity/v3/users => generated 305 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:07.295172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f814ad9-98e6-453b-9005-556522cc9627 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.311203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.316629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f814ad9-98e6-453b-9005-556522cc9627 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.324336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 857/1704] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:07.330154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214b61-4cad-466f-ab25-09aab8d1d4e6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.354997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91fb73-5afa-42e2-a7c5-e5b7bb966565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.361365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91fb73-5afa-42e2-a7c5-e5b7bb966565 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.364709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91fb73-5afa-42e2-a7c5-e5b7bb966565 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.365123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91fb73-5afa-42e2-a7c5-e5b7bb966565 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.365909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91fb73-5afa-42e2-a7c5-e5b7bb966565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.380820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91fb73-5afa-42e2-a7c5-e5b7bb966565 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.385898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b214b61-4cad-466f-ab25-09aab8d1d4e6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.412194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a4601-eb54-4544-a8c1-d7e838383f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.412875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a4601-eb54-4544-a8c1-d7e838383f1d admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.416950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 848/1705] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:07.420631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a4601-eb54-4544-a8c1-d7e838383f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.426788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a4601-eb54-4544-a8c1-d7e838383f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.429395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a4601-eb54-4544-a8c1-d7e838383f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.429925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91fb73-5afa-42e2-a7c5-e5b7bb966565 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.433284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a4601-eb54-4544-a8c1-d7e838383f1d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.473063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91fb73-5afa-42e2-a7c5-e5b7bb966565 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.491534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64515-420c-4511-8e97-1a68013e37d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.492224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64515-420c-4511-8e97-1a68013e37d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.492509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64515-420c-4511-8e97-1a68013e37d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.492787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64515-420c-4511-8e97-1a68013e37d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.493522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e64515-420c-4511-8e97-1a68013e37d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.495172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e64515-420c-4511-8e97-1a68013e37d5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.525212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 858/1706] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:07 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:07.526276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a4601-eb54-4544-a8c1-d7e838383f1d admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.531935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c94a4601-eb54-4544-a8c1-d7e838383f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:07.532761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 849/1707] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:07.538052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64515-420c-4511-8e97-1a68013e37d5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.558061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64515-420c-4511-8e97-1a68013e37d5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.675570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a4601-eb54-4544-a8c1-d7e838383f1d admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.681657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.682695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.683112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.683397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] PATH_INFO: `/v3/projects/29b0fa9a006f41868d4406a2ffe7855a` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.685137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b0fa9a006f41868d4406a2ffe7855a)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.687728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.729135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ec334-3e6e-408b-840e-8ff9f537e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.731447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ec334-3e6e-408b-840e-8ff9f537e9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.731828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ec334-3e6e-408b-840e-8ff9f537e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.732863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ec334-3e6e-408b-840e-8ff9f537e9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.736243 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ec334-3e6e-408b-840e-8ff9f537e9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.740822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ec334-3e6e-408b-840e-8ff9f537e9d6 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.789723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b0fa9a006f41868d4406a2ffe7855a', 'request_id': 'req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:07.797449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b0fa9a006f41868d4406a2ffe7855a', 'request_id': 'req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:07.805553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b0fa9a006f41868d4406a2ffe7855a', 'request_id': 'req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:07.811203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 850/1708] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:07 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:07.815683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ec334-3e6e-408b-840e-8ff9f537e9d6 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.819358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] The token cache is being invalidate because project 29b0fa9a006f41868d4406a2ffe7855a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:07.819576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:07.820318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:07.822742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 859/1709] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:07 2022] DELETE /identity/v3/projects/29b0fa9a006f41868d4406a2ffe7855a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:07.824050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.833519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:07.851623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ec334-3e6e-408b-840e-8ff9f537e9d6 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.926842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed9fe3-9b61-4ebd-b766-e74142bbfc07 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.933201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664837d6-d29c-41a3-b3ef-5a8e600e83fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.934554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664837d6-d29c-41a3-b3ef-5a8e600e83fe admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.934554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664837d6-d29c-41a3-b3ef-5a8e600e83fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.934810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664837d6-d29c-41a3-b3ef-5a8e600e83fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.935852 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664837d6-d29c-41a3-b3ef-5a8e600e83fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.938637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664837d6-d29c-41a3-b3ef-5a8e600e83fe admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.950749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 860/1710] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:07.952566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3bc11-287d-4227-9c96-4c2814352c1d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.952923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3bc11-287d-4227-9c96-4c2814352c1d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.953294 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3bc11-287d-4227-9c96-4c2814352c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.962108 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.986061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c7e3bc11-287d-4227-9c96-4c2814352c1d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:07.986666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.988195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c7e3bc11-287d-4227-9c96-4c2814352c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.012108 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 861/1711] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:08.014341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4afab7-7848-45ce-9986-66ce483dd731 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.015202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7b78b-4fb2-4685-812d-9b8a34cd430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.015844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4afab7-7848-45ce-9986-66ce483dd731 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.016977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7b78b-4fb2-4685-812d-9b8a34cd430a admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.017346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4afab7-7848-45ce-9986-66ce483dd731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.018933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7b78b-4fb2-4685-812d-9b8a34cd430a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.019295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7b78b-4fb2-4685-812d-9b8a34cd430a admin admin] PATH_INFO: `/v3/projects/dd6f7c2aef8d477eb1c6ed3db3a1cdc5/users/1f82736e817c4a4d9ac0e4fb5c2a2aa3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.065655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7b78b-4fb2-4685-812d-9b8a34cd430a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd6f7c2aef8d477eb1c6ed3db3a1cdc5, user_id=1f82736e817c4a4d9ac0e4fb5c2a2aa3, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.075236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7b78b-4fb2-4685-812d-9b8a34cd430a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.090208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-de4afab7-7848-45ce-9986-66ce483dd731 None None] MFA Rules not processed for user `b982efb5297246ccbf6515cf7bc9dde5`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.091984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-de4afab7-7848-45ce-9986-66ce483dd731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.114840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 851/1712] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:07 2022] PUT /identity/v3/projects/dd6f7c2aef8d477eb1c6ed3db3a1cdc5/users/1f82736e817c4a4d9ac0e4fb5c2a2aa3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:08.129791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7b78b-4fb2-4685-812d-9b8a34cd430a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.289518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7b78b-4fb2-4685-812d-9b8a34cd430a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.291711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 862/1713] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:08.293373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4f0a-5ae2-45d5-9703-a7caace5268d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.293661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4f0a-5ae2-45d5-9703-a7caace5268d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.293943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c4f0a-5ae2-45d5-9703-a7caace5268d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.316196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc346564-237a-4613-9ab9-55eda4924ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.317153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346564-237a-4613-9ab9-55eda4924ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.317153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346564-237a-4613-9ab9-55eda4924ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.317407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc346564-237a-4613-9ab9-55eda4924ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.319991 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346564-237a-4613-9ab9-55eda4924ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.323751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc346564-237a-4613-9ab9-55eda4924ec7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.346458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-829c4f0a-5ae2-45d5-9703-a7caace5268d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.347702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-829c4f0a-5ae2-45d5-9703-a7caace5268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.350366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 852/1714] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:08.353651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d6d60-d7c3-4aab-be26-9e8fdaf5f26e None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.354492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d6d60-d7c3-4aab-be26-9e8fdaf5f26e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.354911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d6d60-d7c3-4aab-be26-9e8fdaf5f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.371656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 863/1715] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:08.373873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a742a-fa33-4a4f-8101-a902af5aee47 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.376519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a742a-fa33-4a4f-8101-a902af5aee47 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.377029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a742a-fa33-4a4f-8101-a902af5aee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.398241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b98d6d60-d7c3-4aab-be26-9e8fdaf5f26e None None] MFA Rules not processed for user `eb8df5670686403480cdfd32ac408945`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.401022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b98d6d60-d7c3-4aab-be26-9e8fdaf5f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.479879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-4e1a742a-fa33-4a4f-8101-a902af5aee47 None None] MFA Rules not processed for user `1f82736e817c4a4d9ac0e4fb5c2a2aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.485634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4e1a742a-fa33-4a4f-8101-a902af5aee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.550172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 853/1716] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:08.552080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccc524-f22f-4430-a2c9-a0a2725c35dd None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.552807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccc524-f22f-4430-a2c9-a0a2725c35dd None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.553863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccc524-f22f-4430-a2c9-a0a2725c35dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.632828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-bbccc524-f22f-4430-a2c9-a0a2725c35dd None None] MFA Rules not processed for user `b982efb5297246ccbf6515cf7bc9dde5`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.634218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bbccc524-f22f-4430-a2c9-a0a2725c35dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.675850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 854/1717] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:08.676985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccc524-f22f-4430-a2c9-a0a2725c35dd None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.695660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccc524-f22f-4430-a2c9-a0a2725c35dd None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.702073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2fe03-eb3c-4bfa-bb6b-58c33c0afdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.704000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2fe03-eb3c-4bfa-bb6b-58c33c0afdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.704361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2fe03-eb3c-4bfa-bb6b-58c33c0afdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.705235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2fe03-eb3c-4bfa-bb6b-58c33c0afdfb admin admin] PATH_INFO: `/v3/projects/a2fffbaeb30649d88ffec43a92e1e6a8/users/f0ba1c273d954a9289c9a89a26b508aa/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.732854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2fe03-eb3c-4bfa-bb6b-58c33c0afdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fffbaeb30649d88ffec43a92e1e6a8, user_id=f0ba1c273d954a9289c9a89a26b508aa, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.736444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2fe03-eb3c-4bfa-bb6b-58c33c0afdfb admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.782456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 855/1718] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:08 2022] PUT /identity/v3/projects/a2fffbaeb30649d88ffec43a92e1e6a8/users/f0ba1c273d954a9289c9a89a26b508aa/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:08.783428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2fe03-eb3c-4bfa-bb6b-58c33c0afdfb admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.793094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 864/1719] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:08.801729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379fe01-bc4b-4298-8733-c59a87fc0e3a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.802030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379fe01-bc4b-4298-8733-c59a87fc0e3a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.802332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379fe01-bc4b-4298-8733-c59a87fc0e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.838279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:08.894874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2379fe01-bc4b-4298-8733-c59a87fc0e3a None None] MFA Rules not processed for user `d230950f9e984a8b878d7d0f74dda3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.895859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2fe03-eb3c-4bfa-bb6b-58c33c0afdfb admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.897370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2379fe01-bc4b-4298-8733-c59a87fc0e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.908668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.909636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.910148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.910675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.912088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:08.913207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.915333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.939340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 856/1720] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:08.941294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.947483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:09.059151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.092653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 865/1721] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:09.093736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379fe01-bc4b-4298-8733-c59a87fc0e3a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.100126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2379fe01-bc4b-4298-8733-c59a87fc0e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:09.173445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88ed24-b521-48fa-bae3-23129c19f07b admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.192808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab3ff1-6625-411f-ac52-22ff3fbaeb4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.193910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab3ff1-6625-411f-ac52-22ff3fbaeb4f service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.194437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab3ff1-6625-411f-ac52-22ff3fbaeb4f service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.194975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab3ff1-6625-411f-ac52-22ff3fbaeb4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.291306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab3ff1-6625-411f-ac52-22ff3fbaeb4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.292683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab3ff1-6625-411f-ac52-22ff3fbaeb4f service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.295430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379fe01-bc4b-4298-8733-c59a87fc0e3a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.314094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5d8c2-9f99-4102-b669-da897467e6dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.314849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5d8c2-9f99-4102-b669-da897467e6dd service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.315135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5d8c2-9f99-4102-b669-da897467e6dd service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.315454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 857/1722] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:09.315560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5d8c2-9f99-4102-b669-da897467e6dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.317784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada8a0-c770-4ea4-8b9a-c223430f81ba None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.320404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada8a0-c770-4ea4-8b9a-c223430f81ba None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.320689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada8a0-c770-4ea4-8b9a-c223430f81ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.383292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-04ada8a0-c770-4ea4-8b9a-c223430f81ba None None] MFA Rules not processed for user `f0ba1c273d954a9289c9a89a26b508aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:09.384721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-04ada8a0-c770-4ea4-8b9a-c223430f81ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:09.451585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5d8c2-9f99-4102-b669-da897467e6dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.454020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5d8c2-9f99-4102-b669-da897467e6dd service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.477010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 866/1723] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:09.479128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5d8c2-9f99-4102-b669-da897467e6dd service nova] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.485512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9ca5d8c2-9f99-4102-b669-da897467e6dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:09.517349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5d8c2-9f99-4102-b669-da897467e6dd service nova] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.531768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49e8f-5acb-402e-a243-14e576089e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.532841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49e8f-5acb-402e-a243-14e576089e64 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.533230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49e8f-5acb-402e-a243-14e576089e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.534703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49e8f-5acb-402e-a243-14e576089e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.535263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a49e8f-5acb-402e-a243-14e576089e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.537476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a49e8f-5acb-402e-a243-14e576089e64 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.559989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.600131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 867/1724] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:09 2022] POST /identity/v3/projects => generated 409 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:09.601053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49e8f-5acb-402e-a243-14e576089e64 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.630623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 858/1725] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:09.632250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab5a2-a3a3-438b-b173-ecdf2089fa94 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.632552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab5a2-a3a3-438b-b173-ecdf2089fa94 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.632836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eab5a2-a3a3-438b-b173-ecdf2089fa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.702113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-39eab5a2-a3a3-438b-b173-ecdf2089fa94 None None] MFA Rules not processed for user `d230950f9e984a8b878d7d0f74dda3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:09.706686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-39eab5a2-a3a3-438b-b173-ecdf2089fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:09.844501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 859/1726] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:09.844501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eab5a2-a3a3-438b-b173-ecdf2089fa94 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.844785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49e8f-5acb-402e-a243-14e576089e64 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.853234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c856-a669-409c-98f5-d40b03872458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.854060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c856-a669-409c-98f5-d40b03872458 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.854482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c856-a669-409c-98f5-d40b03872458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.855020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c856-a669-409c-98f5-d40b03872458 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.857171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c856-a669-409c-98f5-d40b03872458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.862703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c856-a669-409c-98f5-d40b03872458 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.864045 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eab5a2-a3a3-438b-b173-ecdf2089fa94 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.870881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6949e-ad7c-4618-a741-0a78d0d7dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.871642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6949e-ad7c-4618-a741-0a78d0d7dccd admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.871952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6949e-ad7c-4618-a741-0a78d0d7dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.872236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6949e-ad7c-4618-a741-0a78d0d7dccd admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.873028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6949e-ad7c-4618-a741-0a78d0d7dccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.875933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6949e-ad7c-4618-a741-0a78d0d7dccd admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.925396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 860/1727] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:09 2022] POST /identity/v3/users => generated 311 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:09.925396 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6949e-ad7c-4618-a741-0a78d0d7dccd admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.925662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.959586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 868/1728] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:09 2022] POST /identity/v3/projects => generated 357 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:09.965737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c856-a669-409c-98f5-d40b03872458 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.978373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6949e-ad7c-4618-a741-0a78d0d7dccd admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.151186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c88f9a-4425-416c-8efe-9bc909a586a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.152295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c88f9a-4425-416c-8efe-9bc909a586a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.152884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c88f9a-4425-416c-8efe-9bc909a586a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.153544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c88f9a-4425-416c-8efe-9bc909a586a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.155122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c88f9a-4425-416c-8efe-9bc909a586a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.157915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c88f9a-4425-416c-8efe-9bc909a586a5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.220636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 861/1729] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:09 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:10.220636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c88f9a-4425-416c-8efe-9bc909a586a5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.387513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c88f9a-4425-416c-8efe-9bc909a586a5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.399666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0e2cd-c0d9-4542-86ad-b5ec95c03903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.400891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0e2cd-c0d9-4542-86ad-b5ec95c03903 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.402493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0e2cd-c0d9-4542-86ad-b5ec95c03903 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.402883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0e2cd-c0d9-4542-86ad-b5ec95c03903 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.404982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0e2cd-c0d9-4542-86ad-b5ec95c03903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.412111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0e2cd-c0d9-4542-86ad-b5ec95c03903 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.413721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:10.441772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 862/1730] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:10.443736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0e2cd-c0d9-4542-86ad-b5ec95c03903 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.470933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0e2cd-c0d9-4542-86ad-b5ec95c03903 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.482462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c856-a669-409c-98f5-d40b03872458 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.490524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03213592-846c-455e-80b5-1b0e17a9d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.492257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03213592-846c-455e-80b5-1b0e17a9d052 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.492767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03213592-846c-455e-80b5-1b0e17a9d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.493454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03213592-846c-455e-80b5-1b0e17a9d052 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.495254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03213592-846c-455e-80b5-1b0e17a9d052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.511809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03213592-846c-455e-80b5-1b0e17a9d052 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.586438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 863/1731] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:10 2022] POST /identity/v3/users => generated 279 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:10.586438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03213592-846c-455e-80b5-1b0e17a9d052 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.613029 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03213592-846c-455e-80b5-1b0e17a9d052 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.634229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9e753-c9af-4045-80fa-e729d46970fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.636150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9e753-c9af-4045-80fa-e729d46970fe admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.637904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9e753-c9af-4045-80fa-e729d46970fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.638199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9e753-c9af-4045-80fa-e729d46970fe admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.638959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9e753-c9af-4045-80fa-e729d46970fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.648372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50a28d-ded2-478c-93ed-30820f23e890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.648933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50a28d-ded2-478c-93ed-30820f23e890 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.649217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50a28d-ded2-478c-93ed-30820f23e890 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.650564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9e753-c9af-4045-80fa-e729d46970fe admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.651955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50a28d-ded2-478c-93ed-30820f23e890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.700505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 864/1732] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:10 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:10.700505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9e753-c9af-4045-80fa-e729d46970fe admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.735654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9e753-c9af-4045-80fa-e729d46970fe admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.745415 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfa708-064c-4b0d-b538-760f3ef0299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.746876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfa708-064c-4b0d-b538-760f3ef0299a admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.747240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfa708-064c-4b0d-b538-760f3ef0299a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.747615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfa708-064c-4b0d-b538-760f3ef0299a admin admin] PATH_INFO: `/v3/projects/4a212bdfdfda48e9ae86c25bb5003837/users/16db102433874ff3b98f057e3a88c0ea/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.773233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfa708-064c-4b0d-b538-760f3ef0299a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a212bdfdfda48e9ae86c25bb5003837, user_id=16db102433874ff3b98f057e3a88c0ea, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.776539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfa708-064c-4b0d-b538-760f3ef0299a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.798102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50a28d-ded2-478c-93ed-30820f23e890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.801819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 865/1733] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:10 2022] PUT /identity/v3/projects/4a212bdfdfda48e9ae86c25bb5003837/users/16db102433874ff3b98f057e3a88c0ea/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:10.806646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50a28d-ded2-478c-93ed-30820f23e890 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.807143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfa708-064c-4b0d-b538-760f3ef0299a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.828060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 869/1734] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 868 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:10.830950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368da32-6e04-4d82-81d9-6ebcf5f6f36f None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.831435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368da32-6e04-4d82-81d9-6ebcf5f6f36f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.831885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368da32-6e04-4d82-81d9-6ebcf5f6f36f None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.837669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 870/1735] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 23 10:50:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:10.839066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368da32-6e04-4d82-81d9-6ebcf5f6f36f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.938276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:10.957244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfa708-064c-4b0d-b538-760f3ef0299a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.975508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec7c80-3305-43a9-8050-7f8c51b3d779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.976728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7c80-3305-43a9-8050-7f8c51b3d779 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.978864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7c80-3305-43a9-8050-7f8c51b3d779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.979661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec7c80-3305-43a9-8050-7f8c51b3d779 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.981862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec7c80-3305-43a9-8050-7f8c51b3d779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.988114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec7c80-3305-43a9-8050-7f8c51b3d779 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.015151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368da32-6e04-4d82-81d9-6ebcf5f6f36f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.019987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 866/1736] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:11.019987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec7c80-3305-43a9-8050-7f8c51b3d779 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.028104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dc208-870d-422c-a514-a01372b9e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.028878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc208-870d-422c-a514-a01372b9e01d admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.029286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc208-870d-422c-a514-a01372b9e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.029621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc208-870d-422c-a514-a01372b9e01d admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.035260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dc208-870d-422c-a514-a01372b9e01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.036984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dc208-870d-422c-a514-a01372b9e01d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.043965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec7c80-3305-43a9-8050-7f8c51b3d779 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.061935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaad1d-2b3d-4c74-9f9a-9b7f47e4f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.065091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaad1d-2b3d-4c74-9f9a-9b7f47e4f330 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.065395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaad1d-2b3d-4c74-9f9a-9b7f47e4f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.065714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaad1d-2b3d-4c74-9f9a-9b7f47e4f330 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.066562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaad1d-2b3d-4c74-9f9a-9b7f47e4f330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.067885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 871/1737] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:11.069684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaad1d-2b3d-4c74-9f9a-9b7f47e4f330 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.073277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3d63-eb1e-48d3-884d-6b1a8e843ca5 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.073575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3d63-eb1e-48d3-884d-6b1a8e843ca5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.073842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc3d63-eb1e-48d3-884d-6b1a8e843ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.097681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 867/1738] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:11.102098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaad1d-2b3d-4c74-9f9a-9b7f47e4f330 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.126472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaad1d-2b3d-4c74-9f9a-9b7f47e4f330 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.142963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47da920-42ab-4617-8087-91f589623b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.143663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47da920-42ab-4617-8087-91f589623b7c admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.143933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47da920-42ab-4617-8087-91f589623b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.144496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47da920-42ab-4617-8087-91f589623b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.145253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47da920-42ab-4617-8087-91f589623b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.146924 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47da920-42ab-4617-8087-91f589623b7c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.158958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-bbcc3d63-eb1e-48d3-884d-6b1a8e843ca5 None None] MFA Rules not processed for user `ed8f21a950d6483abc7ab67fb533942a`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:11.160119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-bbcc3d63-eb1e-48d3-884d-6b1a8e843ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:11.176645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 868/1739] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:11.178274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47da920-42ab-4617-8087-91f589623b7c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.191286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47da920-42ab-4617-8087-91f589623b7c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.197605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fcb92-e2a2-46f7-bd72-9de1c26c16de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.198545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fcb92-e2a2-46f7-bd72-9de1c26c16de admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.199337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fcb92-e2a2-46f7-bd72-9de1c26c16de admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.199337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fcb92-e2a2-46f7-bd72-9de1c26c16de admin admin] PATH_INFO: `/v3/projects/d5c555ca75d749a9a1ef559648f7de3d/users/91148b3480454be78c8bd0b950b98ce3/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.218138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fcb92-e2a2-46f7-bd72-9de1c26c16de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c555ca75d749a9a1ef559648f7de3d, user_id=91148b3480454be78c8bd0b950b98ce3, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.221378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fcb92-e2a2-46f7-bd72-9de1c26c16de admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.223642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 872/1740] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:50:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:11.233893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3d63-eb1e-48d3-884d-6b1a8e843ca5 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.244426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 869/1741] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:11 2022] PUT /identity/v3/projects/d5c555ca75d749a9a1ef559648f7de3d/users/91148b3480454be78c8bd0b950b98ce3/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:11.245359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fcb92-e2a2-46f7-bd72-9de1c26c16de admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.253574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc3d63-eb1e-48d3-884d-6b1a8e843ca5 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.361450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.366853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d9ac-c7ae-446f-a923-a13411939a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.370817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d9ac-c7ae-446f-a923-a13411939a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.371142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d9ac-c7ae-446f-a923-a13411939a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.371616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3d9ac-c7ae-446f-a923-a13411939a3f admin admin] PATH_INFO: `/v3/projects/4a212bdfdfda48e9ae86c25bb5003837/users/16db102433874ff3b98f057e3a88c0ea/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.374822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3d9ac-c7ae-446f-a923-a13411939a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a212bdfdfda48e9ae86c25bb5003837, user_id=16db102433874ff3b98f057e3a88c0ea, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.377738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3d9ac-c7ae-446f-a923-a13411939a3f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.388873 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fcb92-e2a2-46f7-bd72-9de1c26c16de admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.396485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 873/1742] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:11 2022] PUT /identity/v3/projects/4a212bdfdfda48e9ae86c25bb5003837/users/16db102433874ff3b98f057e3a88c0ea/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:11.397481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d9ac-c7ae-446f-a923-a13411939a3f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.512834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f40f0-2412-49e1-85bb-a862b656001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.513743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f40f0-2412-49e1-85bb-a862b656001b admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.514031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f40f0-2412-49e1-85bb-a862b656001b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.514332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f40f0-2412-49e1-85bb-a862b656001b admin admin] PATH_INFO: `/v3/projects/63aa634e9ad049048b860cf511c31a03/users/c52d5908370b4c2487b5f26311212c60/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.527368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3d9ac-c7ae-446f-a923-a13411939a3f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.535074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a023-78dd-4095-837a-e88078bcd9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.536001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a023-78dd-4095-837a-e88078bcd9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.536582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a023-78dd-4095-837a-e88078bcd9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.537004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a023-78dd-4095-837a-e88078bcd9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.537897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644a023-78dd-4095-837a-e88078bcd9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.540020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644a023-78dd-4095-837a-e88078bcd9c5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.543557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.546042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f40f0-2412-49e1-85bb-a862b656001b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63aa634e9ad049048b860cf511c31a03, user_id=c52d5908370b4c2487b5f26311212c60, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.550209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f40f0-2412-49e1-85bb-a862b656001b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.567022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 874/1743] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:11.568502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a023-78dd-4095-837a-e88078bcd9c5 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.573171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8644a023-78dd-4095-837a-e88078bcd9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:11.586990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 870/1744] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:11 2022] PUT /identity/v3/projects/63aa634e9ad049048b860cf511c31a03/users/c52d5908370b4c2487b5f26311212c60/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:11.588899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ffc7-92a5-4ed7-9504-2d2d034271aa None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.589189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ffc7-92a5-4ed7-9504-2d2d034271aa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.589470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ffc7-92a5-4ed7-9504-2d2d034271aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.636662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-9de9ffc7-92a5-4ed7-9504-2d2d034271aa None None] MFA Rules not processed for user `16db102433874ff3b98f057e3a88c0ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:11.637897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9de9ffc7-92a5-4ed7-9504-2d2d034271aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:11.709548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a023-78dd-4095-837a-e88078bcd9c5 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.781491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55c189-9fbb-4d78-afc2-d0c350de60e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.782172 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55c189-9fbb-4d78-afc2-d0c350de60e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.782645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55c189-9fbb-4d78-afc2-d0c350de60e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.782938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55c189-9fbb-4d78-afc2-d0c350de60e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.792972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55c189-9fbb-4d78-afc2-d0c350de60e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.794565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55c189-9fbb-4d78-afc2-d0c350de60e4 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.805416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 875/1745] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:11.807197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab309530-be7f-40bb-82c4-b50ad7bbc4e1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.807638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab309530-be7f-40bb-82c4-b50ad7bbc4e1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.808035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab309530-be7f-40bb-82c4-b50ad7bbc4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.823374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 871/1746] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:11 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:11.827017 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9ffc7-92a5-4ed7-9504-2d2d034271aa None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.844020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ab309530-be7f-40bb-82c4-b50ad7bbc4e1 None None] MFA Rules not processed for user `b0b95c321c4a452faa81a93168c7bf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:11.846059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ab309530-be7f-40bb-82c4-b50ad7bbc4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:11.937792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9ffc7-92a5-4ed7-9504-2d2d034271aa None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.942678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da043dc8-ea2e-4c8a-9834-9fad28c37812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.943779 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043dc8-ea2e-4c8a-9834-9fad28c37812 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.944076 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043dc8-ea2e-4c8a-9834-9fad28c37812 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.944355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043dc8-ea2e-4c8a-9834-9fad28c37812 admin admin] PATH_INFO: `/v3/projects/d5c555ca75d749a9a1ef559648f7de3d/users/91148b3480454be78c8bd0b950b98ce3/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.945021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 876/1747] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:11.948402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da043dc8-ea2e-4c8a-9834-9fad28c37812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5c555ca75d749a9a1ef559648f7de3d, user_id=91148b3480454be78c8bd0b950b98ce3, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.948546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b22ca0-8064-4381-822a-918695372d20 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.948968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b22ca0-8064-4381-822a-918695372d20 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.949584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b22ca0-8064-4381-822a-918695372d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.951307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da043dc8-ea2e-4c8a-9834-9fad28c37812 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.956332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.976284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 872/1748] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:11 2022] PUT /identity/v3/projects/d5c555ca75d749a9a1ef559648f7de3d/users/91148b3480454be78c8bd0b950b98ce3/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:11.978962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bb044-54df-437c-a4ec-f660c516dfaa None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.980001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bb044-54df-437c-a4ec-f660c516dfaa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.981732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bb044-54df-437c-a4ec-f660c516dfaa None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.986827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 873/1749] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jun 23 10:50:11 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:11.987872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bb044-54df-437c-a4ec-f660c516dfaa None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.990010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e21bb044-54df-437c-a4ec-f660c516dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:12.017899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-51b22ca0-8064-4381-822a-918695372d20 None None] MFA Rules not processed for user `c52d5908370b4c2487b5f26311212c60`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:12.019849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-51b22ca0-8064-4381-822a-918695372d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:12.136065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bb044-54df-437c-a4ec-f660c516dfaa None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.137666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.143207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4595fb4-5a93-4318-bbe4-df8da8ebe5d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.143868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595fb4-5a93-4318-bbe4-df8da8ebe5d1 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.144150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595fb4-5a93-4318-bbe4-df8da8ebe5d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.144426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4595fb4-5a93-4318-bbe4-df8da8ebe5d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.173013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 877/1750] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:11 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:12.174451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8a16-74f8-48e6-8fbc-17e67de7e523 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.174739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8a16-74f8-48e6-8fbc-17e67de7e523 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.175013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd8a16-74f8-48e6-8fbc-17e67de7e523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.233880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c9cd8a16-74f8-48e6-8fbc-17e67de7e523 None None] MFA Rules not processed for user `91148b3480454be78c8bd0b950b98ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:12.235964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c9cd8a16-74f8-48e6-8fbc-17e67de7e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:12.294179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4595fb4-5a93-4318-bbe4-df8da8ebe5d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.297392 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4595fb4-5a93-4318-bbe4-df8da8ebe5d1 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.325579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 874/1751] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:12.327212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187c544-796d-4b07-a731-5c60043f9b70 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.328050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187c544-796d-4b07-a731-5c60043f9b70 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.328331 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187c544-796d-4b07-a731-5c60043f9b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.361059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f187c544-796d-4b07-a731-5c60043f9b70 None None] MFA Rules not processed for user `ed8f21a950d6483abc7ab67fb533942a`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:12.362284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f187c544-796d-4b07-a731-5c60043f9b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:12.454823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 878/1752] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:12.455908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd8a16-74f8-48e6-8fbc-17e67de7e523 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.561725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 875/1753] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:12.562881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187c544-796d-4b07-a731-5c60043f9b70 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.578542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187c544-796d-4b07-a731-5c60043f9b70 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.586946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729b322-3558-41d0-837c-a7eab4beaa6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.590073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729b322-3558-41d0-837c-a7eab4beaa6c service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.592239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729b322-3558-41d0-837c-a7eab4beaa6c service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.593843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729b322-3558-41d0-837c-a7eab4beaa6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.615490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729b322-3558-41d0-837c-a7eab4beaa6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.616912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729b322-3558-41d0-837c-a7eab4beaa6c service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.631372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 876/1754] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:12.632463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729b322-3558-41d0-837c-a7eab4beaa6c service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.650173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd8a16-74f8-48e6-8fbc-17e67de7e523 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.653905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729b322-3558-41d0-837c-a7eab4beaa6c service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.660965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676cc6a-0f3a-478d-a09d-0c72f500f956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.661767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676cc6a-0f3a-478d-a09d-0c72f500f956 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.662542 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676cc6a-0f3a-478d-a09d-0c72f500f956 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.662542 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676cc6a-0f3a-478d-a09d-0c72f500f956 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.663243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676cc6a-0f3a-478d-a09d-0c72f500f956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.665252 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676cc6a-0f3a-478d-a09d-0c72f500f956 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.667295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb72647-7816-42e0-803f-76db4badb51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.672120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb72647-7816-42e0-803f-76db4badb51f service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.672263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb72647-7816-42e0-803f-76db4badb51f service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.672464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb72647-7816-42e0-803f-76db4badb51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.708345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb72647-7816-42e0-803f-76db4badb51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.716953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb72647-7816-42e0-803f-76db4badb51f service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.742870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 877/1755] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:12.750931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 879/1756] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:12 2022] POST /identity/v3/projects => generated 355 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:12.752236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb72647-7816-42e0-803f-76db4badb51f service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.772630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cb1f8-a450-459d-b252-d9b428bf66ae None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.772924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cb1f8-a450-459d-b252-d9b428bf66ae None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.773212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cb1f8-a450-459d-b252-d9b428bf66ae None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.776433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 880/1757] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jun 23 10:50:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:12.779244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb72647-7816-42e0-803f-76db4badb51f service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.782691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca04c5-42a8-41f1-9609-54a1ed4e47d1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.782977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca04c5-42a8-41f1-9609-54a1ed4e47d1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.783256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca04c5-42a8-41f1-9609-54a1ed4e47d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.842674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-23ca04c5-42a8-41f1-9609-54a1ed4e47d1 None None] MFA Rules not processed for user `64ce422f60d64b368df8be61e1065282`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:12.853938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-23ca04c5-42a8-41f1-9609-54a1ed4e47d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:12.870008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.964763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120f506-6f45-4654-becc-d4cd9b86fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.965532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120f506-6f45-4654-becc-d4cd9b86fd5e admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.965678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120f506-6f45-4654-becc-d4cd9b86fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.965959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120f506-6f45-4654-becc-d4cd9b86fd5e admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.970674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120f506-6f45-4654-becc-d4cd9b86fd5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.972871 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120f506-6f45-4654-becc-d4cd9b86fd5e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.033431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 878/1758] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:12 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:13.033738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:13.035696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120f506-6f45-4654-becc-d4cd9b86fd5e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.039361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0120f506-6f45-4654-becc-d4cd9b86fd5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:13.061137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 881/1759] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jun 23 10:50:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:13.064287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca04c5-42a8-41f1-9609-54a1ed4e47d1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.105348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca04c5-42a8-41f1-9609-54a1ed4e47d1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.121565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31ca43-4e30-49c3-9304-767cb41badb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.122134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31ca43-4e30-49c3-9304-767cb41badb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.122482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31ca43-4e30-49c3-9304-767cb41badb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.123197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31ca43-4e30-49c3-9304-767cb41badb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.124524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31ca43-4e30-49c3-9304-767cb41badb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.130131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31ca43-4e30-49c3-9304-767cb41badb8 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.183476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 882/1760] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:13.189321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31ca43-4e30-49c3-9304-767cb41badb8 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.234714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31ca43-4e30-49c3-9304-767cb41badb8 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.249834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bcc44-18d6-4803-b28b-4ef16365a34e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.252211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120f506-6f45-4654-becc-d4cd9b86fd5e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.253190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bcc44-18d6-4803-b28b-4ef16365a34e service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.253678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bcc44-18d6-4803-b28b-4ef16365a34e service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.254076 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bcc44-18d6-4803-b28b-4ef16365a34e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.257014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0e0bcc44-18d6-4803-b28b-4ef16365a34e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:13.258569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d32d-5cdb-4c68-81c5-4034029fa08d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.261950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d32d-5cdb-4c68-81c5-4034029fa08d service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.262567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d32d-5cdb-4c68-81c5-4034029fa08d service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.263064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d32d-5cdb-4c68-81c5-4034029fa08d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.296694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bcc44-18d6-4803-b28b-4ef16365a34e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.300591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bcc44-18d6-4803-b28b-4ef16365a34e service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.337333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 883/1761] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:13.341156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bcc44-18d6-4803-b28b-4ef16365a34e service placement] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.356827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3d32d-5cdb-4c68-81c5-4034029fa08d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.358472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3d32d-5cdb-4c68-81c5-4034029fa08d service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.369934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bcc44-18d6-4803-b28b-4ef16365a34e service placement] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.374264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 879/1762] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:13.407456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3fa20-1489-4abc-bc02-104a0cf5f4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.407970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3fa20-1489-4abc-bc02-104a0cf5f4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.408254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3fa20-1489-4abc-bc02-104a0cf5f4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.408530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3fa20-1489-4abc-bc02-104a0cf5f4fe admin admin] PATH_INFO: `/v3/projects/cc64497ba7424bdaafb3a6ac7789c00f/users/cd2c7387c3c74cc4b7961811c3f36550/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.471500 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3fa20-1489-4abc-bc02-104a0cf5f4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc64497ba7424bdaafb3a6ac7789c00f, user_id=cd2c7387c3c74cc4b7961811c3f36550, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.474209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3fa20-1489-4abc-bc02-104a0cf5f4fe admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.535308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d32d-5cdb-4c68-81c5-4034029fa08d service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.542979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 884/1763] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:13 2022] PUT /identity/v3/projects/cc64497ba7424bdaafb3a6ac7789c00f/users/cd2c7387c3c74cc4b7961811c3f36550/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:13.546987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3fa20-1489-4abc-bc02-104a0cf5f4fe admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.734236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d32d-5cdb-4c68-81c5-4034029fa08d service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.792620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:13.836570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3fa20-1489-4abc-bc02-104a0cf5f4fe admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.855267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7284978-fe28-496e-a061-49c1e2fa0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.855955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284978-fe28-496e-a061-49c1e2fa0c65 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.856239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284978-fe28-496e-a061-49c1e2fa0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.856517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7284978-fe28-496e-a061-49c1e2fa0c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.857279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284978-fe28-496e-a061-49c1e2fa0c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.870250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7284978-fe28-496e-a061-49c1e2fa0c65 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.909691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 885/1764] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:13.913406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de729b-cbcd-4ad6-92e9-1528537df1eb None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.913757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de729b-cbcd-4ad6-92e9-1528537df1eb None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.916376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de729b-cbcd-4ad6-92e9-1528537df1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.972067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3040-1490-492e-90fe-4ccb67debcb5 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91148b3480454be78c8bd0b950b98ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5c555ca75d749a9a1ef559648f7de3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.973035 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3040-1490-492e-90fe-4ccb67debcb5 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.973336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3040-1490-492e-90fe-4ccb67debcb5 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.976690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf3040-1490-492e-90fe-4ccb67debcb5 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.980718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf3040-1490-492e-90fe-4ccb67debcb5 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:13.981843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf3040-1490-492e-90fe-4ccb67debcb5 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.985408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a5de729b-cbcd-4ad6-92e9-1528537df1eb None None] MFA Rules not processed for user `eb8df5670686403480cdfd32ac408945`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:13.988137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a5de729b-cbcd-4ad6-92e9-1528537df1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:13.991153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf3040-1490-492e-90fe-4ccb67debcb5 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.057409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 880/1765] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:14.059018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3040-1490-492e-90fe-4ccb67debcb5 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.106669 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf3040-1490-492e-90fe-4ccb67debcb5 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.130422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82150f1-f5f8-40a4-904f-44f4bb55f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:14.146020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82150f1-f5f8-40a4-904f-44f4bb55f13d admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.146442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82150f1-f5f8-40a4-904f-44f4bb55f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.147633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82150f1-f5f8-40a4-904f-44f4bb55f13d admin admin] PATH_INFO: `/v3/projects/cc64497ba7424bdaafb3a6ac7789c00f/users/cd2c7387c3c74cc4b7961811c3f36550/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.159982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82150f1-f5f8-40a4-904f-44f4bb55f13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc64497ba7424bdaafb3a6ac7789c00f, user_id=cd2c7387c3c74cc4b7961811c3f36550, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:14.191102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82150f1-f5f8-40a4-904f-44f4bb55f13d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.236904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 886/1766] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:14.238012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de729b-cbcd-4ad6-92e9-1528537df1eb None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.269373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de729b-cbcd-4ad6-92e9-1528537df1eb None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.281621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 881/1767] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:14 2022] PUT /identity/v3/projects/cc64497ba7424bdaafb3a6ac7789c00f/users/cd2c7387c3c74cc4b7961811c3f36550/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:14.291868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fdc7b-4329-4a67-9af4-17dc0541fd7e None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.292158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fdc7b-4329-4a67-9af4-17dc0541fd7e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.293007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fdc7b-4329-4a67-9af4-17dc0541fd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.397066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8f6fdc7b-4329-4a67-9af4-17dc0541fd7e None None] MFA Rules not processed for user `cd2c7387c3c74cc4b7961811c3f36550`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:14.401766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8f6fdc7b-4329-4a67-9af4-17dc0541fd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:14.429475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:14.456819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1e945-34c8-46f5-8376-8610b48724e4 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91148b3480454be78c8bd0b950b98ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5c555ca75d749a9a1ef559648f7de3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:14.457643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e945-34c8-46f5-8376-8610b48724e4 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.458031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e945-34c8-46f5-8376-8610b48724e4 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.458435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e945-34c8-46f5-8376-8610b48724e4 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.459218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1e945-34c8-46f5-8376-8610b48724e4 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:14.461246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1e945-34c8-46f5-8376-8610b48724e4 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.582945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 887/1768] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:14 2022] POST /identity/v3/projects => generated 351 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:14.594139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1e945-34c8-46f5-8376-8610b48724e4 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.612585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 882/1769] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:14 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:14.626024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fdc7b-4329-4a67-9af4-17dc0541fd7e None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.758414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fdc7b-4329-4a67-9af4-17dc0541fd7e None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.827586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1e945-34c8-46f5-8376-8610b48724e4 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.844407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df7b68-cf9e-476b-9b13-8d10989ad517 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91148b3480454be78c8bd0b950b98ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5c555ca75d749a9a1ef559648f7de3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:14.845162 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df7b68-cf9e-476b-9b13-8d10989ad517 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.845465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df7b68-cf9e-476b-9b13-8d10989ad517 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.845748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df7b68-cf9e-476b-9b13-8d10989ad517 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.847639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df7b68-cf9e-476b-9b13-8d10989ad517 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:14.847961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df7b68-cf9e-476b-9b13-8d10989ad517 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:14.851848 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df7b68-cf9e-476b-9b13-8d10989ad517 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.873233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:14.887606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 888/1770] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:14.894269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be160438-d58e-4644-a093-d55e65143b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:14.895108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be160438-d58e-4644-a093-d55e65143b07 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.895488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be160438-d58e-4644-a093-d55e65143b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.895888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be160438-d58e-4644-a093-d55e65143b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.006743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df7b68-cf9e-476b-9b13-8d10989ad517 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.023714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df7b68-cf9e-476b-9b13-8d10989ad517 tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:15.048943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91148b3480454be78c8bd0b950b98ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5c555ca75d749a9a1ef559648f7de3d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.051197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.051513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.051807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] PATH_INFO: `/v3/projects/ffdfd59014cb4be9954653e37e3aaef4` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.056642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ffdfd59014cb4be9954653e37e3aaef4)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.061158 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.114137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be160438-d58e-4644-a093-d55e65143b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.115893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be160438-d58e-4644-a093-d55e65143b07 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.144298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 883/1771] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:14 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:50:15.234854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdfd59014cb4be9954653e37e3aaef4', 'request_id': 'req-41a7186f-987b-433c-a8f4-2c30816e92aa'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:15.251981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdfd59014cb4be9954653e37e3aaef4', 'request_id': 'req-41a7186f-987b-433c-a8f4-2c30816e92aa'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:15.272457 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdfd59014cb4be9954653e37e3aaef4', 'request_id': 'req-41a7186f-987b-433c-a8f4-2c30816e92aa'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:15.304901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] The token cache is being invalidate because project ffdfd59014cb4be9954653e37e3aaef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:15.305207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:15.305970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-41a7186f-987b-433c-a8f4-2c30816e92aa tempest-VolumeQuotaClassesTest-429370801 tempest-VolumeQuotaClassesTest-429370801-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:15.328849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 889/1772] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:15 2022] DELETE /identity/v3/projects/ffdfd59014cb4be9954653e37e3aaef4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:15.380380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be160438-d58e-4644-a093-d55e65143b07 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.391752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be160438-d58e-4644-a093-d55e65143b07 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:15.400740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc8ab-bc5b-4d22-bea7-85229441cf45 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.401393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc8ab-bc5b-4d22-bea7-85229441cf45 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.401567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc8ab-bc5b-4d22-bea7-85229441cf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.451394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d3dcc8ab-bc5b-4d22-bea7-85229441cf45 None None] MFA Rules not processed for user `d230950f9e984a8b878d7d0f74dda3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:15.454628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d3dcc8ab-bc5b-4d22-bea7-85229441cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:15.645127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.645928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.646078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.646385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.659558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:15.713644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:15.756140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 890/1773] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:15.883199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.889169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.941450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 884/1774] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:15 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:50:16.060835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcc8ab-bc5b-4d22-bea7-85229441cf45 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:16.063032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d3dcc8ab-bc5b-4d22-bea7-85229441cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:16.103326 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcc8ab-bc5b-4d22-bea7-85229441cf45 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:16.116842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e56d0-a56f-4dab-beab-c4b315dfb475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:16.117515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e56d0-a56f-4dab-beab-c4b315dfb475 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:16.117803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e56d0-a56f-4dab-beab-c4b315dfb475 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:16.118086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e56d0-a56f-4dab-beab-c4b315dfb475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:16.130521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b15e56d0-a56f-4dab-beab-c4b315dfb475 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:16.427562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e56d0-a56f-4dab-beab-c4b315dfb475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:16.434195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e56d0-a56f-4dab-beab-c4b315dfb475 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:16.463889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 891/1775] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:16.790895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:16.792839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:16.932802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:17.008301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f648c29-9385-4c5c-a891-621cd8f8f3eb service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:17.025214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:17.028738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.029030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.029318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] PATH_INFO: `/v3/users/f0ba1c273d954a9289c9a89a26b508aa` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.038344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ba1c273d954a9289c9a89a26b508aa)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:17.040549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:17.154736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ba1c273d954a9289c9a89a26b508aa'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:17.156019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ba1c273d954a9289c9a89a26b508aa'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:17.174274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ba1c273d954a9289c9a89a26b508aa'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:17.187325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ba1c273d954a9289c9a89a26b508aa'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:17.199156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ba1c273d954a9289c9a89a26b508aa'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:17.215644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 885/1776] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:16 2022] DELETE /identity/v3/users/f0ba1c273d954a9289c9a89a26b508aa => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:17.217899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72543d-6264-49c9-aa45-2e7d1aac5834 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.218470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72543d-6264-49c9-aa45-2e7d1aac5834 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.218470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72543d-6264-49c9-aa45-2e7d1aac5834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.263109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-3e72543d-6264-49c9-aa45-2e7d1aac5834 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:17.282677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3e72543d-6264-49c9-aa45-2e7d1aac5834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:17.525947 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 892/1777] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:17.538794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:17.540372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:17.623534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97d4ff-d550-405c-8c9c-4d715f9b956a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:17.628764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801e438-683c-4abb-baf9-8ecb5e43c523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:17.629722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801e438-683c-4abb-baf9-8ecb5e43c523 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.629946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801e438-683c-4abb-baf9-8ecb5e43c523 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.630433 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801e438-683c-4abb-baf9-8ecb5e43c523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.642450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801e438-683c-4abb-baf9-8ecb5e43c523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:17.644134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801e438-683c-4abb-baf9-8ecb5e43c523 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:17.688747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 886/1778] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:18.319028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72543d-6264-49c9-aa45-2e7d1aac5834 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.321285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3e72543d-6264-49c9-aa45-2e7d1aac5834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:18.355037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72543d-6264-49c9-aa45-2e7d1aac5834 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.360223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.361094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.361380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.361661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] PATH_INFO: `/v3/projects/a2fffbaeb30649d88ffec43a92e1e6a8` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.362898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fffbaeb30649d88ffec43a92e1e6a8)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:18.364839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:18.508258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fffbaeb30649d88ffec43a92e1e6a8', 'request_id': 'req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.527103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fffbaeb30649d88ffec43a92e1e6a8', 'request_id': 'req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.536064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fffbaeb30649d88ffec43a92e1e6a8', 'request_id': 'req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.555170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] The token cache is being invalidate because project a2fffbaeb30649d88ffec43a92e1e6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:18.557109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.557898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.568103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 893/1779] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:18 2022] DELETE /identity/v3/projects/a2fffbaeb30649d88ffec43a92e1e6a8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:18.571805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801e438-683c-4abb-baf9-8ecb5e43c523 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.586280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801e438-683c-4abb-baf9-8ecb5e43c523 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.674720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.675602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.675883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.676157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] PATH_INFO: `/v3/users/91148b3480454be78c8bd0b950b98ce3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.677393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91148b3480454be78c8bd0b950b98ce3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:18.679394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:18.692146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:18.748507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91148b3480454be78c8bd0b950b98ce3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.749288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91148b3480454be78c8bd0b950b98ce3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.767261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91148b3480454be78c8bd0b950b98ce3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.775159 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91148b3480454be78c8bd0b950b98ce3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.791432 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-94cff007-0530-498e-a51f-0f9999f79682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91148b3480454be78c8bd0b950b98ce3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:18.798429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 887/1780] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:18 2022] DELETE /identity/v3/users/91148b3480454be78c8bd0b950b98ce3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:19.118476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.120183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:19.136403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e56a9b-f192-4989-8ccd-72d8ab5026bc admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.150134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:19.210650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.211609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.211966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.212253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] PATH_INFO: `/v3/projects/d5c555ca75d749a9a1ef559648f7de3d` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.213584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5c555ca75d749a9a1ef559648f7de3d)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.215546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.274340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5c555ca75d749a9a1ef559648f7de3d', 'request_id': 'req-3d90c050-4e12-4108-aa46-18f3a91bac2b'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:19.285137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5c555ca75d749a9a1ef559648f7de3d', 'request_id': 'req-3d90c050-4e12-4108-aa46-18f3a91bac2b'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:19.292231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5c555ca75d749a9a1ef559648f7de3d', 'request_id': 'req-3d90c050-4e12-4108-aa46-18f3a91bac2b'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:19.307505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] The token cache is being invalidate because project d5c555ca75d749a9a1ef559648f7de3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:19.307808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:19.308522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3d90c050-4e12-4108-aa46-18f3a91bac2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:19.310417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 894/1781] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:19 2022] DELETE /identity/v3/projects/d5c555ca75d749a9a1ef559648f7de3d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:19.316220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ee57-0e7c-4be3-8961-4efbcc9ead88 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.316606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ee57-0e7c-4be3-8961-4efbcc9ead88 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.316960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987ee57-0e7c-4be3-8961-4efbcc9ead88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.338581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b987ee57-0e7c-4be3-8961-4efbcc9ead88 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:19.339955 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b987ee57-0e7c-4be3-8961-4efbcc9ead88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:19.442047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 888/1782] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:19.444333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ea4f-f90d-4cd9-8d0a-962271277513 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.445107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ea4f-f90d-4cd9-8d0a-962271277513 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.445390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ea4f-f90d-4cd9-8d0a-962271277513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.472010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-43c4ea4f-f90d-4cd9-8d0a-962271277513 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:19.473379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-43c4ea4f-f90d-4cd9-8d0a-962271277513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:19.491327 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987ee57-0e7c-4be3-8961-4efbcc9ead88 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.491739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 895/1783] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:19.511337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987ee57-0e7c-4be3-8961-4efbcc9ead88 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.527922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7733a66-681e-40aa-94ac-ad859f835ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.528691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733a66-681e-40aa-94ac-ad859f835ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.529047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733a66-681e-40aa-94ac-ad859f835ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.529404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733a66-681e-40aa-94ac-ad859f835ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.530308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7733a66-681e-40aa-94ac-ad859f835ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:19.530703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7733a66-681e-40aa-94ac-ad859f835ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.532407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7733a66-681e-40aa-94ac-ad859f835ea1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.568167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 889/1784] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:19.569110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4ea4f-f90d-4cd9-8d0a-962271277513 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.579834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4ea4f-f90d-4cd9-8d0a-962271277513 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.584935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e461e09-9d8d-4a71-a841-d364b700133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.585583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e461e09-9d8d-4a71-a841-d364b700133b admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.585867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e461e09-9d8d-4a71-a841-d364b700133b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.586140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e461e09-9d8d-4a71-a841-d364b700133b admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.586882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e461e09-9d8d-4a71-a841-d364b700133b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.590097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e461e09-9d8d-4a71-a841-d364b700133b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.645918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 896/1785] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:19 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:50:19.650661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7733a66-681e-40aa-94ac-ad859f835ea1 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.664743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7733a66-681e-40aa-94ac-ad859f835ea1 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.742484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286f074-9d90-4a17-9980-c2c00c7ce1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.743441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286f074-9d90-4a17-9980-c2c00c7ce1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.743789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286f074-9d90-4a17-9980-c2c00c7ce1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.744247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286f074-9d90-4a17-9980-c2c00c7ce1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.744892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286f074-9d90-4a17-9980-c2c00c7ce1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.746929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286f074-9d90-4a17-9980-c2c00c7ce1d5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.773971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 890/1786] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:19 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:19.775444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e461e09-9d8d-4a71-a841-d364b700133b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.786668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e461e09-9d8d-4a71-a841-d364b700133b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.792642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f5291-c185-437f-a16c-7d3bd2b7bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.793347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f5291-c185-437f-a16c-7d3bd2b7bde8 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.793659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f5291-c185-437f-a16c-7d3bd2b7bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.793908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f5291-c185-437f-a16c-7d3bd2b7bde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.794706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f5291-c185-437f-a16c-7d3bd2b7bde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.796462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f5291-c185-437f-a16c-7d3bd2b7bde8 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.807912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 897/1787] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:19.813444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286f074-9d90-4a17-9980-c2c00c7ce1d5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.825667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:19.838642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286f074-9d90-4a17-9980-c2c00c7ce1d5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.847089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba50d3-893a-4dcc-99fb-be8858b985ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.848371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba50d3-893a-4dcc-99fb-be8858b985ce admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.848665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba50d3-893a-4dcc-99fb-be8858b985ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.849857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba50d3-893a-4dcc-99fb-be8858b985ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.851212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba50d3-893a-4dcc-99fb-be8858b985ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.853997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba50d3-893a-4dcc-99fb-be8858b985ce admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.871720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 891/1788] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:19.872891 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f5291-c185-437f-a16c-7d3bd2b7bde8 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.888038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f5291-c185-437f-a16c-7d3bd2b7bde8 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.895942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146544-51b2-47bb-935a-9170c2c2741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.897059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146544-51b2-47bb-935a-9170c2c2741b admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.897415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146544-51b2-47bb-935a-9170c2c2741b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.897793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146544-51b2-47bb-935a-9170c2c2741b admin admin] PATH_INFO: `/v3/projects/20a9e774e8f54917ae9bb767e27b1a74/users/8f49c9c046b74a489e6a91c522e2cbc4/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.922808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a146544-51b2-47bb-935a-9170c2c2741b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a9e774e8f54917ae9bb767e27b1a74, user_id=8f49c9c046b74a489e6a91c522e2cbc4, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.930510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a146544-51b2-47bb-935a-9170c2c2741b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.959970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 898/1789] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:19 2022] PUT /identity/v3/projects/20a9e774e8f54917ae9bb767e27b1a74/users/8f49c9c046b74a489e6a91c522e2cbc4/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:19.970147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978e33e-e5f5-4f0d-9732-dbc33d84c732 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.970469 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978e33e-e5f5-4f0d-9732-dbc33d84c732 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.970755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978e33e-e5f5-4f0d-9732-dbc33d84c732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.007116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-9978e33e-e5f5-4f0d-9732-dbc33d84c732 None None] MFA Rules not processed for user `8f49c9c046b74a489e6a91c522e2cbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:20.008535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9978e33e-e5f5-4f0d-9732-dbc33d84c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:20.085467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 892/1790] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:20.106584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146544-51b2-47bb-935a-9170c2c2741b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:20.109264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-1a146544-51b2-47bb-935a-9170c2c2741b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:20.176063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:20.190489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146544-51b2-47bb-935a-9170c2c2741b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:20.199218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727f7ae-d7a2-4ee6-8f49-f01d8384ee5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a1696d1cc14ca6ac1cb970598f11fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:20.199926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727f7ae-d7a2-4ee6-8f49-f01d8384ee5c service glance] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.200456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727f7ae-d7a2-4ee6-8f49-f01d8384ee5c service glance] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.200788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727f7ae-d7a2-4ee6-8f49-f01d8384ee5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.211382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727f7ae-d7a2-4ee6-8f49-f01d8384ee5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:20.212664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727f7ae-d7a2-4ee6-8f49-f01d8384ee5c service glance] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.223881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 899/1791] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:21.286425 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0e257-fcb3-4865-a0ce-1baa5da8924c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.286963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0e257-fcb3-4865-a0ce-1baa5da8924c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.286963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0e257-fcb3-4865-a0ce-1baa5da8924c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.308958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-28f0e257-fcb3-4865-a0ce-1baa5da8924c None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:21.310446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-28f0e257-fcb3-4865-a0ce-1baa5da8924c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:21.407429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 893/1792] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:50:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:21.590915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727f7ae-d7a2-4ee6-8f49-f01d8384ee5c service glance] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:21.592426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3727f7ae-d7a2-4ee6-8f49-f01d8384ee5c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:21.667666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99f2f6-0d0e-425c-b9f5-e4611d5c07b7 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.668169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99f2f6-0d0e-425c-b9f5-e4611d5c07b7 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.668592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99f2f6-0d0e-425c-b9f5-e4611d5c07b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.727514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3f99f2f6-0d0e-425c-b9f5-e4611d5c07b7 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:21.732221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3f99f2f6-0d0e-425c-b9f5-e4611d5c07b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:21.762992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 894/1793] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:50:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:21.772453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727f7ae-d7a2-4ee6-8f49-f01d8384ee5c service glance] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:21.774370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99f2f6-0d0e-425c-b9f5-e4611d5c07b7 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:21.778089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c27ae5-1a3c-4ea3-82a1-088ebac96a93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:21.778919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c27ae5-1a3c-4ea3-82a1-088ebac96a93 service swift] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.779306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c27ae5-1a3c-4ea3-82a1-088ebac96a93 service swift] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.779685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c27ae5-1a3c-4ea3-82a1-088ebac96a93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.796829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c27ae5-1a3c-4ea3-82a1-088ebac96a93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:21.798787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c27ae5-1a3c-4ea3-82a1-088ebac96a93 service swift] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:21.801724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99f2f6-0d0e-425c-b9f5-e4611d5c07b7 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:21.811254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414e978-cf00-4f72-a650-4ab6f7cf24bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:21.812761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414e978-cf00-4f72-a650-4ab6f7cf24bc service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.812855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414e978-cf00-4f72-a650-4ab6f7cf24bc service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.813060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 900/1794] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:50:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:50:21.813168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414e978-cf00-4f72-a650-4ab6f7cf24bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.831743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414e978-cf00-4f72-a650-4ab6f7cf24bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:21.833546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414e978-cf00-4f72-a650-4ab6f7cf24bc service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:21.851548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 895/1795] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:50:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:50:28.659654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c27ae5-1a3c-4ea3-82a1-088ebac96a93 service swift] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:28.666208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c5c27ae5-1a3c-4ea3-82a1-088ebac96a93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:28.823059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c27ae5-1a3c-4ea3-82a1-088ebac96a93 service swift] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:28.836749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:28.837576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.837853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.838131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] PATH_INFO: `/v3/users/1f82736e817c4a4d9ac0e4fb5c2a2aa3` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.839885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f82736e817c4a4d9ac0e4fb5c2a2aa3)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:28.852359 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:28.994235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f82736e817c4a4d9ac0e4fb5c2a2aa3'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:29.005405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f82736e817c4a4d9ac0e4fb5c2a2aa3'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:29.006838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f82736e817c4a4d9ac0e4fb5c2a2aa3'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:29.025959 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f82736e817c4a4d9ac0e4fb5c2a2aa3'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:29.046640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f82736e817c4a4d9ac0e4fb5c2a2aa3'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:29.053045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:29.087625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 901/1796] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:28 2022] DELETE /identity/v3/users/1f82736e817c4a4d9ac0e4fb5c2a2aa3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:29.093460 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f545b4c-f1c7-4140-86fd-a0c372a44c64 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.094057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f545b4c-f1c7-4140-86fd-a0c372a44c64 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.094666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f545b4c-f1c7-4140-86fd-a0c372a44c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.118966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0f545b4c-f1c7-4140-86fd-a0c372a44c64 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:29.120206 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0f545b4c-f1c7-4140-86fd-a0c372a44c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:29.320806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 896/1797] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:29.331809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:29.333555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:29.399086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cacf34-b420-4a54-81b4-507559cba1c6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:29.402712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c733e2-9fe7-47c4-8ae2-86101c26ea01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:29.403527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c733e2-9fe7-47c4-8ae2-86101c26ea01 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.403819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c733e2-9fe7-47c4-8ae2-86101c26ea01 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.404092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c733e2-9fe7-47c4-8ae2-86101c26ea01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.415333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c733e2-9fe7-47c4-8ae2-86101c26ea01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:29.417137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c733e2-9fe7-47c4-8ae2-86101c26ea01 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:29.430758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 902/1798] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:29.832114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f545b4c-f1c7-4140-86fd-a0c372a44c64 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:29.833614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0f545b4c-f1c7-4140-86fd-a0c372a44c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:29.862941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f545b4c-f1c7-4140-86fd-a0c372a44c64 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:29.897648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:29.898577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.898891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.899156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] PATH_INFO: `/v3/projects/dd6f7c2aef8d477eb1c6ed3db3a1cdc5` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.900518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd6f7c2aef8d477eb1c6ed3db3a1cdc5)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:29.902737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:29.911188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:30.008618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd6f7c2aef8d477eb1c6ed3db3a1cdc5', 'request_id': 'req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.027736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd6f7c2aef8d477eb1c6ed3db3a1cdc5', 'request_id': 'req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.035775 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd6f7c2aef8d477eb1c6ed3db3a1cdc5', 'request_id': 'req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.048285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] The token cache is being invalidate because project dd6f7c2aef8d477eb1c6ed3db3a1cdc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:30.048591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.049245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.051305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 897/1799] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:29 2022] DELETE /identity/v3/projects/dd6f7c2aef8d477eb1c6ed3db3a1cdc5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:30.055150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c733e2-9fe7-47c4-8ae2-86101c26ea01 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.066174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c733e2-9fe7-47c4-8ae2-86101c26ea01 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.182810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.183858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.184503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.184811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] PATH_INFO: `/v3/users/16db102433874ff3b98f057e3a88c0ea` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.190782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] RBAC: Authorizing `identity:delete_user(user_id=16db102433874ff3b98f057e3a88c0ea)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.190782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:30.272665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16db102433874ff3b98f057e3a88c0ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.274367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16db102433874ff3b98f057e3a88c0ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.275723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16db102433874ff3b98f057e3a88c0ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.301228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16db102433874ff3b98f057e3a88c0ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.315868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-efddaf2b-89b5-4e07-a0b0-6f59712e096d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16db102433874ff3b98f057e3a88c0ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:30.338472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 903/1800] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:30 2022] DELETE /identity/v3/users/16db102433874ff3b98f057e3a88c0ea => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:30.813331 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.815072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:30.840548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ffa51-e10b-4a59-b6bd-0898d72aa3ce admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.932967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.933915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.934256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.934566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] PATH_INFO: `/v3/projects/4a212bdfdfda48e9ae86c25bb5003837` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.935747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a212bdfdfda48e9ae86c25bb5003837)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.938587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.028426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a212bdfdfda48e9ae86c25bb5003837', 'request_id': 'req-9c77d16d-6ccc-449d-8676-1811ff463df7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:31.039036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a212bdfdfda48e9ae86c25bb5003837', 'request_id': 'req-9c77d16d-6ccc-449d-8676-1811ff463df7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:31.052897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a212bdfdfda48e9ae86c25bb5003837', 'request_id': 'req-9c77d16d-6ccc-449d-8676-1811ff463df7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:31.065655 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] The token cache is being invalidate because project 4a212bdfdfda48e9ae86c25bb5003837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:31.065943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:31.066644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9c77d16d-6ccc-449d-8676-1811ff463df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:31.068209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 898/1801] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:30 2022] DELETE /identity/v3/projects/4a212bdfdfda48e9ae86c25bb5003837 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:31.073328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d68319-15a3-4ad3-a6e8-d3b08ffb1e1a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.073851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d68319-15a3-4ad3-a6e8-d3b08ffb1e1a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.073941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d68319-15a3-4ad3-a6e8-d3b08ffb1e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.097775 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a3d68319-15a3-4ad3-a6e8-d3b08ffb1e1a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:31.100154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a3d68319-15a3-4ad3-a6e8-d3b08ffb1e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:31.113601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:31.172487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 904/1802] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:31.180539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ab6d9-7180-4c02-af23-fdb8e81a8010 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.180848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ab6d9-7180-4c02-af23-fdb8e81a8010 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.181115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ab6d9-7180-4c02-af23-fdb8e81a8010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.204970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a79ab6d9-7180-4c02-af23-fdb8e81a8010 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:31.206212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a79ab6d9-7180-4c02-af23-fdb8e81a8010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:31.218999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 899/1803] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:31.220430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d68319-15a3-4ad3-a6e8-d3b08ffb1e1a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.230591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d68319-15a3-4ad3-a6e8-d3b08ffb1e1a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.237058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1856ece-551e-45e6-94b3-69bd68f72e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.243188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1856ece-551e-45e6-94b3-69bd68f72e91 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.243558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1856ece-551e-45e6-94b3-69bd68f72e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.243946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1856ece-551e-45e6-94b3-69bd68f72e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.244790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1856ece-551e-45e6-94b3-69bd68f72e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:31.245110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1856ece-551e-45e6-94b3-69bd68f72e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.246864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1856ece-551e-45e6-94b3-69bd68f72e91 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.260471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 905/1804] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:31.265370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ab6d9-7180-4c02-af23-fdb8e81a8010 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.274936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ab6d9-7180-4c02-af23-fdb8e81a8010 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.279586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47292e-c138-49c0-8390-49fc99cbcf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.280307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47292e-c138-49c0-8390-49fc99cbcf71 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.280621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47292e-c138-49c0-8390-49fc99cbcf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.280944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47292e-c138-49c0-8390-49fc99cbcf71 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.281661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47292e-c138-49c0-8390-49fc99cbcf71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.283596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47292e-c138-49c0-8390-49fc99cbcf71 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.307403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:31.326307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 900/1805] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:31.327521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1856ece-551e-45e6-94b3-69bd68f72e91 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.338624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1856ece-551e-45e6-94b3-69bd68f72e91 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.405107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e1a05-915e-4c4d-91a3-1313a60bb3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.406218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e1a05-915e-4c4d-91a3-1313a60bb3ac admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.406819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e1a05-915e-4c4d-91a3-1313a60bb3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.407160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e1a05-915e-4c4d-91a3-1313a60bb3ac admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.408303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e1a05-915e-4c4d-91a3-1313a60bb3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.411573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e1a05-915e-4c4d-91a3-1313a60bb3ac admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.437127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 906/1806] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:31.441732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47292e-c138-49c0-8390-49fc99cbcf71 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.455785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47292e-c138-49c0-8390-49fc99cbcf71 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.461393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073c26c-aad8-4917-b4d9-56bc241a23a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.462193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073c26c-aad8-4917-b4d9-56bc241a23a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.462603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073c26c-aad8-4917-b4d9-56bc241a23a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.462982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073c26c-aad8-4917-b4d9-56bc241a23a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.463824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073c26c-aad8-4917-b4d9-56bc241a23a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.473321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073c26c-aad8-4917-b4d9-56bc241a23a5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.492955 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 901/1807] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:31.496790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e1a05-915e-4c4d-91a3-1313a60bb3ac admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.517118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e1a05-915e-4c4d-91a3-1313a60bb3ac admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.522163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2124d28-0b27-43f3-b729-64be43651eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.522889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124d28-0b27-43f3-b729-64be43651eef admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.523176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124d28-0b27-43f3-b729-64be43651eef admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.523459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2124d28-0b27-43f3-b729-64be43651eef admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.524480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124d28-0b27-43f3-b729-64be43651eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.526402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2124d28-0b27-43f3-b729-64be43651eef admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.540406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 907/1808] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:50:31.543959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073c26c-aad8-4917-b4d9-56bc241a23a5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.560018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073c26c-aad8-4917-b4d9-56bc241a23a5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.566106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12fe4-c720-4ab3-ba3d-9fcc2df553e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.567339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12fe4-c720-4ab3-ba3d-9fcc2df553e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.567744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12fe4-c720-4ab3-ba3d-9fcc2df553e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.568122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf12fe4-c720-4ab3-ba3d-9fcc2df553e4 admin admin] PATH_INFO: `/v3/projects/3c71cd03021f4de58b7415e6290d563a/users/16e4b14181774bb5837ab6366e96cc28/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.599456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12fe4-c720-4ab3-ba3d-9fcc2df553e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c71cd03021f4de58b7415e6290d563a, user_id=16e4b14181774bb5837ab6366e96cc28, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.602146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf12fe4-c720-4ab3-ba3d-9fcc2df553e4 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.622421 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 902/1809] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:31 2022] PUT /identity/v3/projects/3c71cd03021f4de58b7415e6290d563a/users/16e4b14181774bb5837ab6366e96cc28/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:31.627410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c509f-8561-4809-b50e-658a7d8a9756 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.627817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c509f-8561-4809-b50e-658a7d8a9756 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.628198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c509f-8561-4809-b50e-658a7d8a9756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.659064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d13c509f-8561-4809-b50e-658a7d8a9756 None None] MFA Rules not processed for user `16e4b14181774bb5837ab6366e96cc28`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:31.660528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d13c509f-8561-4809-b50e-658a7d8a9756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:31.744615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 908/1810] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:31.753279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12fe4-c720-4ab3-ba3d-9fcc2df553e4 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.843824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf12fe4-c720-4ab3-ba3d-9fcc2df553e4 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.848652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538e8a-cdd2-46dc-b7e9-bff1e6df727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.849416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538e8a-cdd2-46dc-b7e9-bff1e6df727a admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.849766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538e8a-cdd2-46dc-b7e9-bff1e6df727a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.850499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca538e8a-cdd2-46dc-b7e9-bff1e6df727a admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.850944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca538e8a-cdd2-46dc-b7e9-bff1e6df727a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.852903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca538e8a-cdd2-46dc-b7e9-bff1e6df727a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.887804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 903/1811] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:31.892475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c509f-8561-4809-b50e-658a7d8a9756 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.907529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c509f-8561-4809-b50e-658a7d8a9756 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.919735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:31.983607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cbec8-a11d-4417-93b6-6f0474633492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.984276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cbec8-a11d-4417-93b6-6f0474633492 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.984554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cbec8-a11d-4417-93b6-6f0474633492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.984826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cbec8-a11d-4417-93b6-6f0474633492 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.985511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cbec8-a11d-4417-93b6-6f0474633492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.987637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043cbec8-a11d-4417-93b6-6f0474633492 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.016321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 909/1812] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:32.022493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538e8a-cdd2-46dc-b7e9-bff1e6df727a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:32.041095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca538e8a-cdd2-46dc-b7e9-bff1e6df727a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.047292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba986401-002f-4df9-9d3a-50cab539616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.048202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba986401-002f-4df9-9d3a-50cab539616e admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.049014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba986401-002f-4df9-9d3a-50cab539616e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.049527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba986401-002f-4df9-9d3a-50cab539616e admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.050614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba986401-002f-4df9-9d3a-50cab539616e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.052863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba986401-002f-4df9-9d3a-50cab539616e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.065556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 904/1813] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:32.070152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cbec8-a11d-4417-93b6-6f0474633492 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:32.091553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043cbec8-a11d-4417-93b6-6f0474633492 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.097877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d165b-416f-4077-a72b-a9c044863cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.098982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d165b-416f-4077-a72b-a9c044863cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.099262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d165b-416f-4077-a72b-a9c044863cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.099541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d165b-416f-4077-a72b-a9c044863cc2 admin admin] PATH_INFO: `/v3/projects/cafe1e6d56e54cc7b9df1f6cce80a8b8/users/2be4e116b66a44ea94adf2f00847d2e7/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.116045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d165b-416f-4077-a72b-a9c044863cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafe1e6d56e54cc7b9df1f6cce80a8b8, user_id=2be4e116b66a44ea94adf2f00847d2e7, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.118714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d165b-416f-4077-a72b-a9c044863cc2 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.152708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 910/1814] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:32 2022] PUT /identity/v3/projects/cafe1e6d56e54cc7b9df1f6cce80a8b8/users/2be4e116b66a44ea94adf2f00847d2e7/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:50:32.157702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba986401-002f-4df9-9d3a-50cab539616e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:32.172477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba986401-002f-4df9-9d3a-50cab539616e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.247024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addbbdf-d412-4ede-9e03-1db747cf72f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.247691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addbbdf-d412-4ede-9e03-1db747cf72f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.247972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addbbdf-d412-4ede-9e03-1db747cf72f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.248251 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addbbdf-d412-4ede-9e03-1db747cf72f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.249718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addbbdf-d412-4ede-9e03-1db747cf72f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.251519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addbbdf-d412-4ede-9e03-1db747cf72f2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.262116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 905/1815] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:32.266760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d165b-416f-4077-a72b-a9c044863cc2 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:32.277755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d165b-416f-4077-a72b-a9c044863cc2 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.283321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5696aab-cc91-41bc-841f-39cb1a16e343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.284235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5696aab-cc91-41bc-841f-39cb1a16e343 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.284523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5696aab-cc91-41bc-841f-39cb1a16e343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.284805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5696aab-cc91-41bc-841f-39cb1a16e343 admin admin] PATH_INFO: `/v3/projects/cafe1e6d56e54cc7b9df1f6cce80a8b8/users/2be4e116b66a44ea94adf2f00847d2e7/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.286893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5696aab-cc91-41bc-841f-39cb1a16e343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cafe1e6d56e54cc7b9df1f6cce80a8b8, user_id=2be4e116b66a44ea94adf2f00847d2e7, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.289574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5696aab-cc91-41bc-841f-39cb1a16e343 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.301692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 911/1816] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:32 2022] PUT /identity/v3/projects/cafe1e6d56e54cc7b9df1f6cce80a8b8/users/2be4e116b66a44ea94adf2f00847d2e7/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:50:32.313823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a90bd-3535-4cb6-a4e4-1aad5a037108 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.314172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a90bd-3535-4cb6-a4e4-1aad5a037108 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.314405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a90bd-3535-4cb6-a4e4-1aad5a037108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.344896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-e29a90bd-3535-4cb6-a4e4-1aad5a037108 None None] MFA Rules not processed for user `2be4e116b66a44ea94adf2f00847d2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:32.349338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e29a90bd-3535-4cb6-a4e4-1aad5a037108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:32.377537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:32.444829 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 906/1817] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:32.455912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5696aab-cc91-41bc-841f-39cb1a16e343 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:32.457679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e5696aab-cc91-41bc-841f-39cb1a16e343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:32.529150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5696aab-cc91-41bc-841f-39cb1a16e343 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.533726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53192a8-4baa-4003-a47b-7b230048ea0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.535376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53192a8-4baa-4003-a47b-7b230048ea0d service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.535492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53192a8-4baa-4003-a47b-7b230048ea0d service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.536739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53192a8-4baa-4003-a47b-7b230048ea0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.548800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53192a8-4baa-4003-a47b-7b230048ea0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.550438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53192a8-4baa-4003-a47b-7b230048ea0d service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.561413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 912/1818] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:33.329310 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a90bd-3535-4cb6-a4e4-1aad5a037108 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:33.414794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a90bd-3535-4cb6-a4e4-1aad5a037108 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:33.419282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:33.420148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.420931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.421282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] PATH_INFO: `/v3/users/16e4b14181774bb5837ab6366e96cc28` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.422611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e4b14181774bb5837ab6366e96cc28)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:33.424541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:33.481095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e4b14181774bb5837ab6366e96cc28'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:33.481761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e4b14181774bb5837ab6366e96cc28'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:33.494653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e4b14181774bb5837ab6366e96cc28'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:33.502269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e4b14181774bb5837ab6366e96cc28'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:33.509772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e4b14181774bb5837ab6366e96cc28'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:33.523820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 907/1819] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:33 2022] DELETE /identity/v3/users/16e4b14181774bb5837ab6366e96cc28 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:33.528341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f4eb-9a23-4175-ab4a-4c8abc6fe285 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.528862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f4eb-9a23-4175-ab4a-4c8abc6fe285 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.528937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6f4eb-9a23-4175-ab4a-4c8abc6fe285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.551708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-91e6f4eb-9a23-4175-ab4a-4c8abc6fe285 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:33.552941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-91e6f4eb-9a23-4175-ab4a-4c8abc6fe285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:33.617732 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 913/1820] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:33.628554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:33.630025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:33.666053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:33.692967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b3130-4b6d-482c-8738-15e766eccf29 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:33.696944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cddc70-6994-43b3-a00e-32d8755b54d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:33.697950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cddc70-6994-43b3-a00e-32d8755b54d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.698270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cddc70-6994-43b3-a00e-32d8755b54d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.698642 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cddc70-6994-43b3-a00e-32d8755b54d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.709774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cddc70-6994-43b3-a00e-32d8755b54d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:33.711354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cddc70-6994-43b3-a00e-32d8755b54d4 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:33.722166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 908/1821] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:34.050506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f4eb-9a23-4175-ab4a-4c8abc6fe285 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.052439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-91e6f4eb-9a23-4175-ab4a-4c8abc6fe285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:34.065517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6f4eb-9a23-4175-ab4a-4c8abc6fe285 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.092596 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.093769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.094166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.094338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] PATH_INFO: `/v3/projects/3c71cd03021f4de58b7415e6290d563a` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.095567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c71cd03021f4de58b7415e6290d563a)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.097503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.099604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:34.148147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c71cd03021f4de58b7415e6290d563a', 'request_id': 'req-833f4c93-800c-41b1-a2f7-583f1dbdc88a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.159670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c71cd03021f4de58b7415e6290d563a', 'request_id': 'req-833f4c93-800c-41b1-a2f7-583f1dbdc88a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.166489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c71cd03021f4de58b7415e6290d563a', 'request_id': 'req-833f4c93-800c-41b1-a2f7-583f1dbdc88a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.177912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] The token cache is being invalidate because project 3c71cd03021f4de58b7415e6290d563a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:34.178213 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.178899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.180518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 914/1822] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:34 2022] DELETE /identity/v3/projects/3c71cd03021f4de58b7415e6290d563a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:34.184902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cddc70-6994-43b3-a00e-32d8755b54d4 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.195234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cddc70-6994-43b3-a00e-32d8755b54d4 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.253199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.254061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.254360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.254639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] PATH_INFO: `/v3/users/2be4e116b66a44ea94adf2f00847d2e7` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.255809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be4e116b66a44ea94adf2f00847d2e7)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.257756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.303584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be4e116b66a44ea94adf2f00847d2e7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.304464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be4e116b66a44ea94adf2f00847d2e7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.316954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be4e116b66a44ea94adf2f00847d2e7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.324061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be4e116b66a44ea94adf2f00847d2e7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.333303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-817cfd7d-2347-4045-a7a8-f5bc1fe08ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be4e116b66a44ea94adf2f00847d2e7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.339962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 909/1823] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:34 2022] DELETE /identity/v3/users/2be4e116b66a44ea94adf2f00847d2e7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:34.617093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.618656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:34.632928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f4c93-800c-41b1-a2f7-583f1dbdc88a admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.690102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.690930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.691215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.691496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] PATH_INFO: `/v3/projects/cafe1e6d56e54cc7b9df1f6cce80a8b8` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.692692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cafe1e6d56e54cc7b9df1f6cce80a8b8)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.694721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.742027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafe1e6d56e54cc7b9df1f6cce80a8b8', 'request_id': 'req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.749026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafe1e6d56e54cc7b9df1f6cce80a8b8', 'request_id': 'req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.755136 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafe1e6d56e54cc7b9df1f6cce80a8b8', 'request_id': 'req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.765389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] The token cache is being invalidate because project cafe1e6d56e54cc7b9df1f6cce80a8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:34.765680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.766374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cce6e09b-d9ba-421a-836c-ff44d2cd5ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:34.767927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 915/1824] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:34 2022] DELETE /identity/v3/projects/cafe1e6d56e54cc7b9df1f6cce80a8b8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:34.772780 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6295c5-5a23-4410-8e14-2635de885e14 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.773090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6295c5-5a23-4410-8e14-2635de885e14 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.773370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6295c5-5a23-4410-8e14-2635de885e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.791901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0c6295c5-5a23-4410-8e14-2635de885e14 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:34.793092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0c6295c5-5a23-4410-8e14-2635de885e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:34.839817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:34.854033 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 910/1825] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:34.862533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf02c9-9fe2-4958-af1d-8022e7b02314 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.862850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf02c9-9fe2-4958-af1d-8022e7b02314 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.863163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf02c9-9fe2-4958-af1d-8022e7b02314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.881742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-b2cf02c9-9fe2-4958-af1d-8022e7b02314 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:34.882978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b2cf02c9-9fe2-4958-af1d-8022e7b02314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:34.891337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 916/1826] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:34.895840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6295c5-5a23-4410-8e14-2635de885e14 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.906285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6295c5-5a23-4410-8e14-2635de885e14 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.911099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e735-3e3c-4b34-a434-b763708309ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.915570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e735-3e3c-4b34-a434-b763708309ef admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.915862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e735-3e3c-4b34-a434-b763708309ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.916143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23e735-3e3c-4b34-a434-b763708309ef admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.916875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23e735-3e3c-4b34-a434-b763708309ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:34.917179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23e735-3e3c-4b34-a434-b763708309ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.918783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23e735-3e3c-4b34-a434-b763708309ef admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.931191 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 911/1827] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:34.935250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf02c9-9fe2-4958-af1d-8022e7b02314 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.944800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf02c9-9fe2-4958-af1d-8022e7b02314 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.949629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aaf31-1efd-4bed-b805-36d059be6c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.950338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aaf31-1efd-4bed-b805-36d059be6c79 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.950772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aaf31-1efd-4bed-b805-36d059be6c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.951263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aaf31-1efd-4bed-b805-36d059be6c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.952738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aaf31-1efd-4bed-b805-36d059be6c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.954886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aaf31-1efd-4bed-b805-36d059be6c79 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.964642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:34.981946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 917/1828] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:34 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:34.986609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e735-3e3c-4b34-a434-b763708309ef admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.996479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23e735-3e3c-4b34-a434-b763708309ef admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.053552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525c4dd-f24d-4f6a-b129-bf95e5dba9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.054220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525c4dd-f24d-4f6a-b129-bf95e5dba9df admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.054539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525c4dd-f24d-4f6a-b129-bf95e5dba9df admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.054819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525c4dd-f24d-4f6a-b129-bf95e5dba9df admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.055508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525c4dd-f24d-4f6a-b129-bf95e5dba9df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.057432 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525c4dd-f24d-4f6a-b129-bf95e5dba9df admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.076275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 912/1829] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:34 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:50:35.081377 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aaf31-1efd-4bed-b805-36d059be6c79 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.091864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aaf31-1efd-4bed-b805-36d059be6c79 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.098989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e2707-bb5f-4cf5-8682-ebcffe480c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.099668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e2707-bb5f-4cf5-8682-ebcffe480c5b admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.099950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e2707-bb5f-4cf5-8682-ebcffe480c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.100224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e2707-bb5f-4cf5-8682-ebcffe480c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.100965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e2707-bb5f-4cf5-8682-ebcffe480c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.102936 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e2707-bb5f-4cf5-8682-ebcffe480c5b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.116082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 918/1830] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:35.120289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525c4dd-f24d-4f6a-b129-bf95e5dba9df admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.130732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525c4dd-f24d-4f6a-b129-bf95e5dba9df admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.135523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4bf67-7e48-48dc-ae41-51c47d9d8152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.136182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4bf67-7e48-48dc-ae41-51c47d9d8152 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.136471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4bf67-7e48-48dc-ae41-51c47d9d8152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.136755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4bf67-7e48-48dc-ae41-51c47d9d8152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.137479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4bf67-7e48-48dc-ae41-51c47d9d8152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.139704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4bf67-7e48-48dc-ae41-51c47d9d8152 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.150659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 913/1831] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:50:35.155408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e2707-bb5f-4cf5-8682-ebcffe480c5b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.166098 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e2707-bb5f-4cf5-8682-ebcffe480c5b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.171140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9ca2-979d-4d29-832a-15c2ec620b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.172028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9ca2-979d-4d29-832a-15c2ec620b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.172322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9ca2-979d-4d29-832a-15c2ec620b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.172589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb9ca2-979d-4d29-832a-15c2ec620b8c admin admin] PATH_INFO: `/v3/projects/5bf1b4c53bb84c599d5fecf5db9d344a/users/5065057b55b845dfbc0681d7e0407ad3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.189952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb9ca2-979d-4d29-832a-15c2ec620b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf1b4c53bb84c599d5fecf5db9d344a, user_id=5065057b55b845dfbc0681d7e0407ad3, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.192684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb9ca2-979d-4d29-832a-15c2ec620b8c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.208431 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 919/1832] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:35 2022] PUT /identity/v3/projects/5bf1b4c53bb84c599d5fecf5db9d344a/users/5065057b55b845dfbc0681d7e0407ad3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:35.219909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ca785-3bab-4892-b39d-8bb80c043855 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.220203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ca785-3bab-4892-b39d-8bb80c043855 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.221419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ca785-3bab-4892-b39d-8bb80c043855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.250213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-682ca785-3bab-4892-b39d-8bb80c043855 None None] MFA Rules not processed for user `5065057b55b845dfbc0681d7e0407ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:35.251572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-682ca785-3bab-4892-b39d-8bb80c043855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:35.330722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 914/1833] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:35.335362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9ca2-979d-4d29-832a-15c2ec620b8c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.397886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb9ca2-979d-4d29-832a-15c2ec620b8c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.402590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2fa8c-738c-4bc2-8150-a2452abf8c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.403247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2fa8c-738c-4bc2-8150-a2452abf8c12 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.403530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2fa8c-738c-4bc2-8150-a2452abf8c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.403811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2fa8c-738c-4bc2-8150-a2452abf8c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.404503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2fa8c-738c-4bc2-8150-a2452abf8c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.407096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2fa8c-738c-4bc2-8150-a2452abf8c12 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.437687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 920/1834] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:35 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:35.439172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ca785-3bab-4892-b39d-8bb80c043855 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.450925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ca785-3bab-4892-b39d-8bb80c043855 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.501176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:35.512474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1215fa-7c6f-4464-ab6c-d84365ea8a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.513149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1215fa-7c6f-4464-ab6c-d84365ea8a57 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.513429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1215fa-7c6f-4464-ab6c-d84365ea8a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.513705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1215fa-7c6f-4464-ab6c-d84365ea8a57 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.514623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1215fa-7c6f-4464-ab6c-d84365ea8a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.516722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1215fa-7c6f-4464-ab6c-d84365ea8a57 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.538395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 915/1835] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:35 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:35.542495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2fa8c-738c-4bc2-8150-a2452abf8c12 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.554122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2fa8c-738c-4bc2-8150-a2452abf8c12 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.559144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1559348-4c57-4511-8d89-a0f2ced5977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.559817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1559348-4c57-4511-8d89-a0f2ced5977f admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.560103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1559348-4c57-4511-8d89-a0f2ced5977f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.560377 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1559348-4c57-4511-8d89-a0f2ced5977f admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.561295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1559348-4c57-4511-8d89-a0f2ced5977f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.563295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1559348-4c57-4511-8d89-a0f2ced5977f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.574629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 921/1836] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:35.578684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1215fa-7c6f-4464-ab6c-d84365ea8a57 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.589053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1215fa-7c6f-4464-ab6c-d84365ea8a57 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.594103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b55ed-141c-40ca-8d3e-2376fb8f2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.595000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b55ed-141c-40ca-8d3e-2376fb8f2cab admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.595277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b55ed-141c-40ca-8d3e-2376fb8f2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.595555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b55ed-141c-40ca-8d3e-2376fb8f2cab admin admin] PATH_INFO: `/v3/projects/f3aea669cfb84c32bd36e0df037479fa/users/d3329c7f4bd840a7b1e6413e834fb02c/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.610596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b55ed-141c-40ca-8d3e-2376fb8f2cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3aea669cfb84c32bd36e0df037479fa, user_id=d3329c7f4bd840a7b1e6413e834fb02c, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.613220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b55ed-141c-40ca-8d3e-2376fb8f2cab admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.626184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 916/1837] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:35 2022] PUT /identity/v3/projects/f3aea669cfb84c32bd36e0df037479fa/users/d3329c7f4bd840a7b1e6413e834fb02c/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:35.630227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1559348-4c57-4511-8d89-a0f2ced5977f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.640482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1559348-4c57-4511-8d89-a0f2ced5977f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.695707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c8040-7cda-427c-ac79-a7c9cf006d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.696394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c8040-7cda-427c-ac79-a7c9cf006d14 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.696676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c8040-7cda-427c-ac79-a7c9cf006d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.696954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c8040-7cda-427c-ac79-a7c9cf006d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.697964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c8040-7cda-427c-ac79-a7c9cf006d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.699616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c8040-7cda-427c-ac79-a7c9cf006d14 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.709960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 922/1838] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:35.714012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b55ed-141c-40ca-8d3e-2376fb8f2cab admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.725341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b55ed-141c-40ca-8d3e-2376fb8f2cab admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.729891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa910c-f0f9-4b44-ba3c-d9c4b1477e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.730803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa910c-f0f9-4b44-ba3c-d9c4b1477e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.731085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa910c-f0f9-4b44-ba3c-d9c4b1477e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.731362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa910c-f0f9-4b44-ba3c-d9c4b1477e8a admin admin] PATH_INFO: `/v3/projects/f3aea669cfb84c32bd36e0df037479fa/users/d3329c7f4bd840a7b1e6413e834fb02c/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.733785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa910c-f0f9-4b44-ba3c-d9c4b1477e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3aea669cfb84c32bd36e0df037479fa, user_id=d3329c7f4bd840a7b1e6413e834fb02c, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.736461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa910c-f0f9-4b44-ba3c-d9c4b1477e8a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.746395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 917/1839] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:35 2022] PUT /identity/v3/projects/f3aea669cfb84c32bd36e0df037479fa/users/d3329c7f4bd840a7b1e6413e834fb02c/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:35.756762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8460c5-ef25-4435-811f-0978f0bf894a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.757081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8460c5-ef25-4435-811f-0978f0bf894a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.757472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8460c5-ef25-4435-811f-0978f0bf894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.784361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-6a8460c5-ef25-4435-811f-0978f0bf894a None None] MFA Rules not processed for user `d3329c7f4bd840a7b1e6413e834fb02c`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:35.785558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6a8460c5-ef25-4435-811f-0978f0bf894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:35.798179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:35.855286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 923/1840] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:35.867009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa910c-f0f9-4b44-ba3c-d9c4b1477e8a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.868703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4cfa910c-f0f9-4b44-ba3c-d9c4b1477e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:35.927151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa910c-f0f9-4b44-ba3c-d9c4b1477e8a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.930925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fe0fb-3d12-4e52-8695-75d0fb864204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.931568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fe0fb-3d12-4e52-8695-75d0fb864204 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.931833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fe0fb-3d12-4e52-8695-75d0fb864204 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.932108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fe0fb-3d12-4e52-8695-75d0fb864204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.941816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fe0fb-3d12-4e52-8695-75d0fb864204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.943361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fe0fb-3d12-4e52-8695-75d0fb864204 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.954398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 918/1841] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:36.039073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8460c5-ef25-4435-811f-0978f0bf894a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.048600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8460c5-ef25-4435-811f-0978f0bf894a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.052206 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29ea0-13c1-46f0-8f3c-29782783dbc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.052841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29ea0-13c1-46f0-8f3c-29782783dbc5 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.053124 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29ea0-13c1-46f0-8f3c-29782783dbc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.053400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29ea0-13c1-46f0-8f3c-29782783dbc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.114953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29ea0-13c1-46f0-8f3c-29782783dbc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.116443 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29ea0-13c1-46f0-8f3c-29782783dbc5 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.125837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 924/1842] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:36.411749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fe0fb-3d12-4e52-8695-75d0fb864204 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.476716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fe0fb-3d12-4e52-8695-75d0fb864204 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.481401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.482413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.482946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.483328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] PATH_INFO: `/v3/users/5065057b55b845dfbc0681d7e0407ad3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.484982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5065057b55b845dfbc0681d7e0407ad3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.487208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.551896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5065057b55b845dfbc0681d7e0407ad3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:36.552565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5065057b55b845dfbc0681d7e0407ad3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:36.553706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.566497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5065057b55b845dfbc0681d7e0407ad3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:36.573971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5065057b55b845dfbc0681d7e0407ad3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:36.582457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5065057b55b845dfbc0681d7e0407ad3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:36.589487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 919/1843] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:36 2022] DELETE /identity/v3/users/5065057b55b845dfbc0681d7e0407ad3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:36.594721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f970d2b-dada-4811-a557-c7ff31903d17 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.595037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f970d2b-dada-4811-a557-c7ff31903d17 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.595317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f970d2b-dada-4811-a557-c7ff31903d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.612034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-4f970d2b-dada-4811-a557-c7ff31903d17 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:36.613229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4f970d2b-dada-4811-a557-c7ff31903d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:36.676139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 925/1844] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:36.681739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.683192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:36.741052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9fa7e-8538-4c9c-9ce7-e73c35515a30 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.744555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9214a1-9896-4482-bacd-3121197a2ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.745189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9214a1-9896-4482-bacd-3121197a2ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.745487 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9214a1-9896-4482-bacd-3121197a2ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.745762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9214a1-9896-4482-bacd-3121197a2ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.754794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9214a1-9896-4482-bacd-3121197a2ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.756217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9214a1-9896-4482-bacd-3121197a2ac2 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.766227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 920/1845] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:37.156789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f970d2b-dada-4811-a557-c7ff31903d17 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:37.158660 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4f970d2b-dada-4811-a557-c7ff31903d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:37.172202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f970d2b-dada-4811-a557-c7ff31903d17 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:37.177090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:37.178057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:37.178382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:37.178670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] PATH_INFO: `/v3/projects/5bf1b4c53bb84c599d5fecf5db9d344a` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:37.179903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf1b4c53bb84c599d5fecf5db9d344a)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:37.182415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:37.234670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:37.237441 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf1b4c53bb84c599d5fecf5db9d344a', 'request_id': 'req-546697cb-06a0-4211-838c-c250d09b2779'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.247595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf1b4c53bb84c599d5fecf5db9d344a', 'request_id': 'req-546697cb-06a0-4211-838c-c250d09b2779'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.255177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf1b4c53bb84c599d5fecf5db9d344a', 'request_id': 'req-546697cb-06a0-4211-838c-c250d09b2779'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.271077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] The token cache is being invalidate because project 5bf1b4c53bb84c599d5fecf5db9d344a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:37.271393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.272045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.273697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 926/1846] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:37 2022] DELETE /identity/v3/projects/5bf1b4c53bb84c599d5fecf5db9d344a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:50:37.277453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9214a1-9896-4482-bacd-3121197a2ac2 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:37.287545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9214a1-9896-4482-bacd-3121197a2ac2 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:37.354674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:37.355549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:37.355833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:37.356110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] PATH_INFO: `/v3/users/d3329c7f4bd840a7b1e6413e834fb02c` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:37.357307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3329c7f4bd840a7b1e6413e834fb02c)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:37.360002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:37.407378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3329c7f4bd840a7b1e6413e834fb02c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.408032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3329c7f4bd840a7b1e6413e834fb02c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.419587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3329c7f4bd840a7b1e6413e834fb02c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.424434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:37.427630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3329c7f4bd840a7b1e6413e834fb02c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.435776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-85400c99-7c94-449f-8111-c556531e1193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3329c7f4bd840a7b1e6413e834fb02c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.443757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 921/1847] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:37 2022] DELETE /identity/v3/users/d3329c7f4bd840a7b1e6413e834fb02c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:37.841817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:37.844484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:37.857608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546697cb-06a0-4211-838c-c250d09b2779 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:37.917695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:37.918581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:37.918863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:37.919140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] PATH_INFO: `/v3/projects/f3aea669cfb84c32bd36e0df037479fa` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:37.920877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3aea669cfb84c32bd36e0df037479fa)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:37.922797 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:37.966847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3aea669cfb84c32bd36e0df037479fa', 'request_id': 'req-8ca27f16-0396-4585-b802-28b9fc006bdf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.974083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3aea669cfb84c32bd36e0df037479fa', 'request_id': 'req-8ca27f16-0396-4585-b802-28b9fc006bdf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.980115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3aea669cfb84c32bd36e0df037479fa', 'request_id': 'req-8ca27f16-0396-4585-b802-28b9fc006bdf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.991018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] The token cache is being invalidate because project f3aea669cfb84c32bd36e0df037479fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:37.991307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.991947 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ca27f16-0396-4585-b802-28b9fc006bdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:37.996677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 927/1848] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:37 2022] DELETE /identity/v3/projects/f3aea669cfb84c32bd36e0df037479fa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:38.000312 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91231323-ba9c-4fe0-9545-162bf22717d2 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.000738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91231323-ba9c-4fe0-9545-162bf22717d2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.000886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91231323-ba9c-4fe0-9545-162bf22717d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.019234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-91231323-ba9c-4fe0-9545-162bf22717d2 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:38.020445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-91231323-ba9c-4fe0-9545-162bf22717d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:38.080177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 922/1849] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:38.087989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2842-76bc-4675-9f72-bf6afc3b092c None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.088286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2842-76bc-4675-9f72-bf6afc3b092c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.088576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2842-76bc-4675-9f72-bf6afc3b092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.109374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-85ef2842-76bc-4675-9f72-bf6afc3b092c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:38.110635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-85ef2842-76bc-4675-9f72-bf6afc3b092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:38.118654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 928/1850] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:38.122836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91231323-ba9c-4fe0-9545-162bf22717d2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.133234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91231323-ba9c-4fe0-9545-162bf22717d2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.137820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5836ea7-c2b8-4513-9b85-f9564c4f23b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.138514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5836ea7-c2b8-4513-9b85-f9564c4f23b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.138803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5836ea7-c2b8-4513-9b85-f9564c4f23b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.139151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5836ea7-c2b8-4513-9b85-f9564c4f23b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.139878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5836ea7-c2b8-4513-9b85-f9564c4f23b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:38.140184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5836ea7-c2b8-4513-9b85-f9564c4f23b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.141827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5836ea7-c2b8-4513-9b85-f9564c4f23b1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.153467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 923/1851] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:38.157772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef2842-76bc-4675-9f72-bf6afc3b092c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.166854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef2842-76bc-4675-9f72-bf6afc3b092c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.171978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52acde5-e363-4308-b288-d2c9760013ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.172614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52acde5-e363-4308-b288-d2c9760013ff admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.172899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52acde5-e363-4308-b288-d2c9760013ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.173174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52acde5-e363-4308-b288-d2c9760013ff admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.173861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52acde5-e363-4308-b288-d2c9760013ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.175769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52acde5-e363-4308-b288-d2c9760013ff admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.203433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 929/1852] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:38 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:38.207720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5836ea7-c2b8-4513-9b85-f9564c4f23b1 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.217597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5836ea7-c2b8-4513-9b85-f9564c4f23b1 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.272218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15548579-fc72-40aa-b4c2-4289cfb29720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.272873 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15548579-fc72-40aa-b4c2-4289cfb29720 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.273165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15548579-fc72-40aa-b4c2-4289cfb29720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.273442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15548579-fc72-40aa-b4c2-4289cfb29720 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.274130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15548579-fc72-40aa-b4c2-4289cfb29720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.276099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15548579-fc72-40aa-b4c2-4289cfb29720 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.295368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 924/1853] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:38 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:38.300135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52acde5-e363-4308-b288-d2c9760013ff admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.310393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52acde5-e363-4308-b288-d2c9760013ff admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.315240 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff083e-c59e-483f-b086-12044b492fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.315895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff083e-c59e-483f-b086-12044b492fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.316182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff083e-c59e-483f-b086-12044b492fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.316462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff083e-c59e-483f-b086-12044b492fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.317188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff083e-c59e-483f-b086-12044b492fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.318830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff083e-c59e-483f-b086-12044b492fa3 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.329547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 930/1854] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:38.333409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15548579-fc72-40aa-b4c2-4289cfb29720 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.344464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15548579-fc72-40aa-b4c2-4289cfb29720 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.349177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4882a6-3d7f-476f-a799-2f1973b9d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.349985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4882a6-3d7f-476f-a799-2f1973b9d500 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.350098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4882a6-3d7f-476f-a799-2f1973b9d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.350392 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4882a6-3d7f-476f-a799-2f1973b9d500 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.351113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4882a6-3d7f-476f-a799-2f1973b9d500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.352691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4882a6-3d7f-476f-a799-2f1973b9d500 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.363994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 925/1855] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:38.368102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff083e-c59e-483f-b086-12044b492fa3 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.378575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff083e-c59e-483f-b086-12044b492fa3 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.383678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2f86b-0926-4506-88ad-d5ef63315e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.384691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2f86b-0926-4506-88ad-d5ef63315e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.384969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2f86b-0926-4506-88ad-d5ef63315e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.385248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2f86b-0926-4506-88ad-d5ef63315e5e admin admin] PATH_INFO: `/v3/projects/43487b90fb914664bc34189acb929291/users/e5220d40c6ed4245bcbcf87f67cdd150/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.402078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2f86b-0926-4506-88ad-d5ef63315e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=43487b90fb914664bc34189acb929291, user_id=e5220d40c6ed4245bcbcf87f67cdd150, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.405367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2f86b-0926-4506-88ad-d5ef63315e5e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.420107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 931/1856] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:38 2022] PUT /identity/v3/projects/43487b90fb914664bc34189acb929291/users/e5220d40c6ed4245bcbcf87f67cdd150/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:38.421125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:38.425931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a62435-3366-4aab-b541-897641ee6206 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.426276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a62435-3366-4aab-b541-897641ee6206 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.426584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a62435-3366-4aab-b541-897641ee6206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.447747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b9a62435-3366-4aab-b541-897641ee6206 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:38.448940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b9a62435-3366-4aab-b541-897641ee6206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:38.495337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:38.509155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 926/1857] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:38.518719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2f86b-0926-4506-88ad-d5ef63315e5e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.520489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-61b2f86b-0926-4506-88ad-d5ef63315e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:38.579054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2f86b-0926-4506-88ad-d5ef63315e5e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.582700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b55fd5-d006-43b4-bc8b-aa654925c298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.583345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b55fd5-d006-43b4-bc8b-aa654925c298 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.583677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b55fd5-d006-43b4-bc8b-aa654925c298 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.583908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b55fd5-d006-43b4-bc8b-aa654925c298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.594134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b55fd5-d006-43b4-bc8b-aa654925c298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.595605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b55fd5-d006-43b4-bc8b-aa654925c298 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.605230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 932/1858] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:50:39.471117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fad63-dc5f-4c99-8a2c-0c392e889b4b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.471571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fad63-dc5f-4c99-8a2c-0c392e889b4b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.471660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fad63-dc5f-4c99-8a2c-0c392e889b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.527208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b67fad63-dc5f-4c99-8a2c-0c392e889b4b None None] MFA Rules not processed for user `ed8f21a950d6483abc7ab67fb533942a`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:39.531913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b67fad63-dc5f-4c99-8a2c-0c392e889b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:39.566299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 927/1859] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 23 10:50:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:39.660525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab83b9-d104-451c-b7a7-f969f95c283e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.661066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab83b9-d104-451c-b7a7-f969f95c283e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.661184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab83b9-d104-451c-b7a7-f969f95c283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.700568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-5eab83b9-d104-451c-b7a7-f969f95c283e None None] MFA Rules not processed for user `e5220d40c6ed4245bcbcf87f67cdd150`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:39.702438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5eab83b9-d104-451c-b7a7-f969f95c283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:39.831120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 933/1860] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:50:39.836890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fad63-dc5f-4c99-8a2c-0c392e889b4b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.859078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab83b9-d104-451c-b7a7-f969f95c283e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.860913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5eab83b9-d104-451c-b7a7-f969f95c283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:39.864791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fad63-dc5f-4c99-8a2c-0c392e889b4b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.876168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767be35-4e9e-4c24-9391-2aea03db16f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.878082 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767be35-4e9e-4c24-9391-2aea03db16f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.878905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767be35-4e9e-4c24-9391-2aea03db16f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.880268 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767be35-4e9e-4c24-9391-2aea03db16f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.881069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767be35-4e9e-4c24-9391-2aea03db16f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.882739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab83b9-d104-451c-b7a7-f969f95c283e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.885322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767be35-4e9e-4c24-9391-2aea03db16f3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.894728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35add-1f7f-46cb-bd66-adb6afbeb58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.895502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35add-1f7f-46cb-bd66-adb6afbeb58b service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.895866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35add-1f7f-46cb-bd66-adb6afbeb58b service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.896228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35add-1f7f-46cb-bd66-adb6afbeb58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.912088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e35add-1f7f-46cb-bd66-adb6afbeb58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.914071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e35add-1f7f-46cb-bd66-adb6afbeb58b service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.938399 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 934/1861] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:50:39.996586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 928/1862] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:39 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:40.001639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35add-1f7f-46cb-bd66-adb6afbeb58b service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.031189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35add-1f7f-46cb-bd66-adb6afbeb58b service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.172358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cfee0-15d5-4868-b4ae-78f6cf5fe20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.173308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cfee0-15d5-4868-b4ae-78f6cf5fe20a admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.173759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cfee0-15d5-4868-b4ae-78f6cf5fe20a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.174259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cfee0-15d5-4868-b4ae-78f6cf5fe20a admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.175117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cfee0-15d5-4868-b4ae-78f6cf5fe20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.177712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cfee0-15d5-4868-b4ae-78f6cf5fe20a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.209532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 935/1863] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:40 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:40.213061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767be35-4e9e-4c24-9391-2aea03db16f3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.228995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767be35-4e9e-4c24-9391-2aea03db16f3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.235019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f714786-8e6d-4bf9-8106-99854c07b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.235814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f714786-8e6d-4bf9-8106-99854c07b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.236166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f714786-8e6d-4bf9-8106-99854c07b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.236523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f714786-8e6d-4bf9-8106-99854c07b5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.237374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f714786-8e6d-4bf9-8106-99854c07b5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.239418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f714786-8e6d-4bf9-8106-99854c07b5d1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.256026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 929/1864] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:40.260268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cfee0-15d5-4868-b4ae-78f6cf5fe20a admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.274235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cfee0-15d5-4868-b4ae-78f6cf5fe20a admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.279877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380b2db-6a4d-4469-9b29-36080c4da29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.280802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380b2db-6a4d-4469-9b29-36080c4da29c admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.281088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380b2db-6a4d-4469-9b29-36080c4da29c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.281371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380b2db-6a4d-4469-9b29-36080c4da29c admin admin] PATH_INFO: `/v3/projects/7bd7cce8a53147baa62b8e9a976ab5cf/users/8110ed4429bd477b82cb385a590b8fdf/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.286669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:40.306145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380b2db-6a4d-4469-9b29-36080c4da29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd7cce8a53147baa62b8e9a976ab5cf, user_id=8110ed4429bd477b82cb385a590b8fdf, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.311376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380b2db-6a4d-4469-9b29-36080c4da29c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.347251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 936/1865] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:40 2022] PUT /identity/v3/projects/7bd7cce8a53147baa62b8e9a976ab5cf/users/8110ed4429bd477b82cb385a590b8fdf/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:40.347883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f714786-8e6d-4bf9-8106-99854c07b5d1 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.363741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f714786-8e6d-4bf9-8106-99854c07b5d1 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.531639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51001c64-ad61-4801-a58b-98587b6525ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.532419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51001c64-ad61-4801-a58b-98587b6525ab admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.532711 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51001c64-ad61-4801-a58b-98587b6525ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.532989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51001c64-ad61-4801-a58b-98587b6525ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.533943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51001c64-ad61-4801-a58b-98587b6525ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.535730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51001c64-ad61-4801-a58b-98587b6525ab admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.560766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 930/1866] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:40.565567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380b2db-6a4d-4469-9b29-36080c4da29c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.583766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380b2db-6a4d-4469-9b29-36080c4da29c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.594268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df9c41-b0f6-4a8f-9a3e-918c7474e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.595373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df9c41-b0f6-4a8f-9a3e-918c7474e124 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.596136 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df9c41-b0f6-4a8f-9a3e-918c7474e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.596254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df9c41-b0f6-4a8f-9a3e-918c7474e124 admin admin] PATH_INFO: `/v3/projects/7bd7cce8a53147baa62b8e9a976ab5cf/users/8110ed4429bd477b82cb385a590b8fdf/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.602424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df9c41-b0f6-4a8f-9a3e-918c7474e124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd7cce8a53147baa62b8e9a976ab5cf, user_id=8110ed4429bd477b82cb385a590b8fdf, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.604860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df9c41-b0f6-4a8f-9a3e-918c7474e124 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.619350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 937/1867] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:40 2022] PUT /identity/v3/projects/7bd7cce8a53147baa62b8e9a976ab5cf/users/8110ed4429bd477b82cb385a590b8fdf/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:42.585887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec1b46-a7c0-4506-9c5f-efdaed49e885 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.588873 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec1b46-a7c0-4506-9c5f-efdaed49e885 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.589192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec1b46-a7c0-4506-9c5f-efdaed49e885 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.592034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 931/1868] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:50:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:42.601359 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e81a-b5f8-4699-9041-8ebd42306f14 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.601878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e81a-b5f8-4699-9041-8ebd42306f14 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.601878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e81a-b5f8-4699-9041-8ebd42306f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.631072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-5cd0e81a-b5f8-4699-9041-8ebd42306f14 None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:42.632432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5cd0e81a-b5f8-4699-9041-8ebd42306f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:42.725516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 938/1869] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:50:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:42.740195 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec1b46-a7c0-4506-9c5f-efdaed49e885 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:42.742452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2bec1b46-a7c0-4506-9c5f-efdaed49e885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:42.763411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec1b46-a7c0-4506-9c5f-efdaed49e885 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:42.769679 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9f1cd-cfbb-44c2-b781-aec59cabfaab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:42.770358 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f1cd-cfbb-44c2-b781-aec59cabfaab service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.770832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f1cd-cfbb-44c2-b781-aec59cabfaab service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.771378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9f1cd-cfbb-44c2-b781-aec59cabfaab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.782197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9f1cd-cfbb-44c2-b781-aec59cabfaab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:42.783847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9f1cd-cfbb-44c2-b781-aec59cabfaab service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:42.803608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 932/1870] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:43.190015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9670c0-4cf6-408f-a07a-709b071e9060 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.190345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9670c0-4cf6-408f-a07a-709b071e9060 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.190815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9670c0-4cf6-408f-a07a-709b071e9060 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.192456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 939/1871] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:43.220693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914d976-6299-4b33-8e26-5cea15b3647a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.221052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914d976-6299-4b33-8e26-5cea15b3647a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.221266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914d976-6299-4b33-8e26-5cea15b3647a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.282711 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7914d976-6299-4b33-8e26-5cea15b3647a None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:43.283964 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7914d976-6299-4b33-8e26-5cea15b3647a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:43.310233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 933/1872] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:43.350260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226668a-731b-41b7-a4c0-c1b8feafa0d5 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.350630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226668a-731b-41b7-a4c0-c1b8feafa0d5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.350954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226668a-731b-41b7-a4c0-c1b8feafa0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.379224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914d976-6299-4b33-8e26-5cea15b3647a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.396861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914d976-6299-4b33-8e26-5cea15b3647a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:43.406565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a226668a-731b-41b7-a4c0-c1b8feafa0d5 None None] MFA Rules not processed for user `8110ed4429bd477b82cb385a590b8fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:43.407239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a226668a-731b-41b7-a4c0-c1b8feafa0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:43.428646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bbdfb-2163-4a16-8b65-32d5b449e8cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:43.429317 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bbdfb-2163-4a16-8b65-32d5b449e8cc service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.429597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bbdfb-2163-4a16-8b65-32d5b449e8cc service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.429867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bbdfb-2163-4a16-8b65-32d5b449e8cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.459319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bbdfb-2163-4a16-8b65-32d5b449e8cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:43.464118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bbdfb-2163-4a16-8b65-32d5b449e8cc service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:43.510405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 934/1873] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:43.540245 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 940/1874] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:43.549954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bbdfb-2163-4a16-8b65-32d5b449e8cc service nova] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.551804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7b8bbdfb-2163-4a16-8b65-32d5b449e8cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:43.685106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bbdfb-2163-4a16-8b65-32d5b449e8cc service nova] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:43.695081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177099-17e6-4a36-b029-969fb9c63f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:43.697721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177099-17e6-4a36-b029-969fb9c63f39 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.698008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177099-17e6-4a36-b029-969fb9c63f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.698288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177099-17e6-4a36-b029-969fb9c63f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.773363 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:43.818180 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60177099-17e6-4a36-b029-969fb9c63f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:43.824719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60177099-17e6-4a36-b029-969fb9c63f39 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:43.838492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 935/1875] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:48.516353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226668a-731b-41b7-a4c0-c1b8feafa0d5 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.518168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a226668a-731b-41b7-a4c0-c1b8feafa0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:48.532523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226668a-731b-41b7-a4c0-c1b8feafa0d5 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.540651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc5579-a07c-4695-bfd2-80a0097b6ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.540651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5579-a07c-4695-bfd2-80a0097b6ebb service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.540651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5579-a07c-4695-bfd2-80a0097b6ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.540651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5579-a07c-4695-bfd2-80a0097b6ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.563052 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc5579-a07c-4695-bfd2-80a0097b6ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.564722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc5579-a07c-4695-bfd2-80a0097b6ebb service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.590576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 941/1876] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:49.277365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177099-17e6-4a36-b029-969fb9c63f39 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:49.278795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-60177099-17e6-4a36-b029-969fb9c63f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:49.347378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177099-17e6-4a36-b029-969fb9c63f39 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:49.351860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:49.352731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:49.353013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:49.353290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] PATH_INFO: `/v3/users/c52d5908370b4c2487b5f26311212c60` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:49.354508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52d5908370b4c2487b5f26311212c60)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:49.356427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:49.410647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52d5908370b4c2487b5f26311212c60'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:49.411306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52d5908370b4c2487b5f26311212c60'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:49.423063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52d5908370b4c2487b5f26311212c60'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:49.429745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52d5908370b4c2487b5f26311212c60'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:49.437719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52d5908370b4c2487b5f26311212c60'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:49.443682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 936/1877] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:49 2022] DELETE /identity/v3/users/c52d5908370b4c2487b5f26311212c60 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:49.448421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2a79a-edce-49cc-b7a1-38fc6d816efe None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:49.448709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2a79a-edce-49cc-b7a1-38fc6d816efe None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:49.448991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2a79a-edce-49cc-b7a1-38fc6d816efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:49.469306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8ba2a79a-edce-49cc-b7a1-38fc6d816efe None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:49.470554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8ba2a79a-edce-49cc-b7a1-38fc6d816efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:49.499628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:49.530689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 942/1878] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:49.540273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:49.541780 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:49.617645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770de8b-96e5-44b1-b8bd-28e74644b5ff admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:49.621598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e46e4e-ff98-41a1-95e7-d406c3f1aec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:49.622380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e46e4e-ff98-41a1-95e7-d406c3f1aec4 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:49.622742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e46e4e-ff98-41a1-95e7-d406c3f1aec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:49.623098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e46e4e-ff98-41a1-95e7-d406c3f1aec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:49.630467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:49.634986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e46e4e-ff98-41a1-95e7-d406c3f1aec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:49.637289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e46e4e-ff98-41a1-95e7-d406c3f1aec4 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:49.649865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 937/1879] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:50.302410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2a79a-edce-49cc-b7a1-38fc6d816efe None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:50.304051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8ba2a79a-edce-49cc-b7a1-38fc6d816efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:50.320751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2a79a-edce-49cc-b7a1-38fc6d816efe None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:50.326151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:50.328527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:50.328527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:50.328700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] PATH_INFO: `/v3/projects/63aa634e9ad049048b860cf511c31a03` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:50.329943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63aa634e9ad049048b860cf511c31a03)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:50.333297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:50.429704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63aa634e9ad049048b860cf511c31a03', 'request_id': 'req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.437658 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63aa634e9ad049048b860cf511c31a03', 'request_id': 'req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.444173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63aa634e9ad049048b860cf511c31a03', 'request_id': 'req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.455833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] The token cache is being invalidate because project 63aa634e9ad049048b860cf511c31a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:50.456120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.456780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.458386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 943/1880] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:50 2022] DELETE /identity/v3/projects/63aa634e9ad049048b860cf511c31a03 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:50.462271 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e46e4e-ff98-41a1-95e7-d406c3f1aec4 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:50.473523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e46e4e-ff98-41a1-95e7-d406c3f1aec4 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:50.530501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:50.531377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:50.531664 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:50.531944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] PATH_INFO: `/v3/users/cd2c7387c3c74cc4b7961811c3f36550` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:50.533174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2c7387c3c74cc4b7961811c3f36550)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:50.535232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:50.583014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2c7387c3c74cc4b7961811c3f36550'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.583702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2c7387c3c74cc4b7961811c3f36550'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.596187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2c7387c3c74cc4b7961811c3f36550'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.603027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2c7387c3c74cc4b7961811c3f36550'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.610520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-00bf4a6d-b4c5-448c-a696-44fe8c9d44ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2c7387c3c74cc4b7961811c3f36550'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:50.616685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 938/1881] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:50:50 2022] DELETE /identity/v3/users/cd2c7387c3c74cc4b7961811c3f36550 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:50.889468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:50.890877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:50.909172 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432a639-19c7-4a3f-bd15-2d6c9f6ae76f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:50.967138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:50.967989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:50.968269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:50.968551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] PATH_INFO: `/v3/projects/cc64497ba7424bdaafb3a6ac7789c00f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:50.969727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc64497ba7424bdaafb3a6ac7789c00f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:50.971657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.016291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc64497ba7424bdaafb3a6ac7789c00f', 'request_id': 'req-bdf94384-8c2e-4e1b-a156-000687a9b949'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:51.024832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc64497ba7424bdaafb3a6ac7789c00f', 'request_id': 'req-bdf94384-8c2e-4e1b-a156-000687a9b949'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:51.032041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc64497ba7424bdaafb3a6ac7789c00f', 'request_id': 'req-bdf94384-8c2e-4e1b-a156-000687a9b949'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:51.036139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:51.048123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] The token cache is being invalidate because project cc64497ba7424bdaafb3a6ac7789c00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:50:51.048848 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:51.050696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bdf94384-8c2e-4e1b-a156-000687a9b949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:50:51.052627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 944/1882] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:50:50 2022] DELETE /identity/v3/projects/cc64497ba7424bdaafb3a6ac7789c00f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:51.057463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9e29-b997-483e-8ca2-c1e7d6711437 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.057917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9e29-b997-483e-8ca2-c1e7d6711437 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.058345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9e29-b997-483e-8ca2-c1e7d6711437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.088885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b14c9e29-b997-483e-8ca2-c1e7d6711437 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:51.090290 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b14c9e29-b997-483e-8ca2-c1e7d6711437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:51.158663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 939/1883] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:51.166480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e768d2-3b9f-4ecf-af37-832fe6d2792e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.166773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e768d2-3b9f-4ecf-af37-832fe6d2792e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.167053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e768d2-3b9f-4ecf-af37-832fe6d2792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.187764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-54e768d2-3b9f-4ecf-af37-832fe6d2792e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:51.191181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-54e768d2-3b9f-4ecf-af37-832fe6d2792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:51.200077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 945/1884] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:51.205075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c9e29-b997-483e-8ca2-c1e7d6711437 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.215550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c9e29-b997-483e-8ca2-c1e7d6711437 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.222281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9400-c544-426f-ad98-030cc0a84ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.222816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9400-c544-426f-ad98-030cc0a84ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.223154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9400-c544-426f-ad98-030cc0a84ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.223378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9400-c544-426f-ad98-030cc0a84ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.224121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e9400-c544-426f-ad98-030cc0a84ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:51.224444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e9400-c544-426f-ad98-030cc0a84ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.226074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e9400-c544-426f-ad98-030cc0a84ee8 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.235533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:51.244124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 940/1885] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:51.245179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e768d2-3b9f-4ecf-af37-832fe6d2792e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.255644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e768d2-3b9f-4ecf-af37-832fe6d2792e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.266840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f52f-94f4-452f-af96-4d2c6fea3b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.267523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f52f-94f4-452f-af96-4d2c6fea3b56 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.267884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f52f-94f4-452f-af96-4d2c6fea3b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.268400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f52f-94f4-452f-af96-4d2c6fea3b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.269513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f52f-94f4-452f-af96-4d2c6fea3b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.271935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f52f-94f4-452f-af96-4d2c6fea3b56 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.302010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 946/1886] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:51.308977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9400-c544-426f-ad98-030cc0a84ee8 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.317401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9400-c544-426f-ad98-030cc0a84ee8 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.377989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930f476-6f4b-4391-8eaa-b9888379d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.378783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930f476-6f4b-4391-8eaa-b9888379d7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.379064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930f476-6f4b-4391-8eaa-b9888379d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.379343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930f476-6f4b-4391-8eaa-b9888379d7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.380071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930f476-6f4b-4391-8eaa-b9888379d7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.382102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930f476-6f4b-4391-8eaa-b9888379d7b5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.407325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 941/1887] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:51.411433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f52f-94f4-452f-af96-4d2c6fea3b56 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.425956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f52f-94f4-452f-af96-4d2c6fea3b56 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.434671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb2df6-11dd-4c5b-a5a4-e5c7180fa057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.435335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb2df6-11dd-4c5b-a5a4-e5c7180fa057 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.435620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb2df6-11dd-4c5b-a5a4-e5c7180fa057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.435930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb2df6-11dd-4c5b-a5a4-e5c7180fa057 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.436722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb2df6-11dd-4c5b-a5a4-e5c7180fa057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.438310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb2df6-11dd-4c5b-a5a4-e5c7180fa057 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.449655 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 947/1888] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:51.455038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930f476-6f4b-4391-8eaa-b9888379d7b5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.465911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930f476-6f4b-4391-8eaa-b9888379d7b5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.471507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986e01-d6a7-4f30-b651-b18e4ef074f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.472174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986e01-d6a7-4f30-b651-b18e4ef074f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.472452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986e01-d6a7-4f30-b651-b18e4ef074f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.472748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986e01-d6a7-4f30-b651-b18e4ef074f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.473475 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986e01-d6a7-4f30-b651-b18e4ef074f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.475100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986e01-d6a7-4f30-b651-b18e4ef074f1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.489053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 942/1889] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:51.490409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb2df6-11dd-4c5b-a5a4-e5c7180fa057 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.501376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb2df6-11dd-4c5b-a5a4-e5c7180fa057 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.505993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe14ffa-39e4-48f5-a305-19487b780bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.506908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe14ffa-39e4-48f5-a305-19487b780bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.507190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe14ffa-39e4-48f5-a305-19487b780bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.507466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe14ffa-39e4-48f5-a305-19487b780bfc admin admin] PATH_INFO: `/v3/projects/920ace146a4844c4ada41fbfc6fbc780/users/851eecb7b6ac4b559e79d920dc0fe30b/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.527562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe14ffa-39e4-48f5-a305-19487b780bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=920ace146a4844c4ada41fbfc6fbc780, user_id=851eecb7b6ac4b559e79d920dc0fe30b, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.530384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe14ffa-39e4-48f5-a305-19487b780bfc admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.547147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 948/1890] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:51 2022] PUT /identity/v3/projects/920ace146a4844c4ada41fbfc6fbc780/users/851eecb7b6ac4b559e79d920dc0fe30b/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:51.556828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c85051-70e4-493d-b152-9dbf151a5cc0 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.557243 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c85051-70e4-493d-b152-9dbf151a5cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.557626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c85051-70e4-493d-b152-9dbf151a5cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.590372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-14c85051-70e4-493d-b152-9dbf151a5cc0 None None] MFA Rules not processed for user `851eecb7b6ac4b559e79d920dc0fe30b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:51.591641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-14c85051-70e4-493d-b152-9dbf151a5cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:51.672262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 943/1891] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:51.676590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe14ffa-39e4-48f5-a305-19487b780bfc admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.737201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe14ffa-39e4-48f5-a305-19487b780bfc admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.741845 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efd3f9-f399-471d-8877-3318c4826bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.742522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efd3f9-f399-471d-8877-3318c4826bcd admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.742806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efd3f9-f399-471d-8877-3318c4826bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.743079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efd3f9-f399-471d-8877-3318c4826bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.743756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efd3f9-f399-471d-8877-3318c4826bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.745643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efd3f9-f399-471d-8877-3318c4826bcd admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.771155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 949/1892] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:51.775360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c85051-70e4-493d-b152-9dbf151a5cc0 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.786809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c85051-70e4-493d-b152-9dbf151a5cc0 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.843474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a914c8e-e5e2-4c32-af24-cef07b6bfaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.844136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a914c8e-e5e2-4c32-af24-cef07b6bfaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.844421 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a914c8e-e5e2-4c32-af24-cef07b6bfaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.844702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a914c8e-e5e2-4c32-af24-cef07b6bfaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.845413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a914c8e-e5e2-4c32-af24-cef07b6bfaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.847485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a914c8e-e5e2-4c32-af24-cef07b6bfaa3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.861484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:51.868890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 944/1893] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:51.872042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efd3f9-f399-471d-8877-3318c4826bcd admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.883362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efd3f9-f399-471d-8877-3318c4826bcd admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.887997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcf5c3-53d5-4031-84b6-fce23e530088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.888650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcf5c3-53d5-4031-84b6-fce23e530088 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.889008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcf5c3-53d5-4031-84b6-fce23e530088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.889294 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcf5c3-53d5-4031-84b6-fce23e530088 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.890623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcf5c3-53d5-4031-84b6-fce23e530088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.892224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcf5c3-53d5-4031-84b6-fce23e530088 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.903038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 950/1894] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:51.907178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a914c8e-e5e2-4c32-af24-cef07b6bfaa3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.917058 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a914c8e-e5e2-4c32-af24-cef07b6bfaa3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.922173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d1ae-6749-42d3-9b64-4b81aae38c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.923145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d1ae-6749-42d3-9b64-4b81aae38c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.923392 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d1ae-6749-42d3-9b64-4b81aae38c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.923667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7d1ae-6749-42d3-9b64-4b81aae38c0a admin admin] PATH_INFO: `/v3/projects/6dba76c16a84470db3c1fd7449751cd9/users/17807c676111466c930963591fc5e221/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.938961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d1ae-6749-42d3-9b64-4b81aae38c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dba76c16a84470db3c1fd7449751cd9, user_id=17807c676111466c930963591fc5e221, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.941627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7d1ae-6749-42d3-9b64-4b81aae38c0a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.957802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 945/1895] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:51 2022] PUT /identity/v3/projects/6dba76c16a84470db3c1fd7449751cd9/users/17807c676111466c930963591fc5e221/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:51.961747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcf5c3-53d5-4031-84b6-fce23e530088 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.972085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcf5c3-53d5-4031-84b6-fce23e530088 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:52.026654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e7036-d2ba-46c6-8aae-07a2280b5767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:52.027309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e7036-d2ba-46c6-8aae-07a2280b5767 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.027593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e7036-d2ba-46c6-8aae-07a2280b5767 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.027873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e7036-d2ba-46c6-8aae-07a2280b5767 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.028584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e7036-d2ba-46c6-8aae-07a2280b5767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:52.030341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e7036-d2ba-46c6-8aae-07a2280b5767 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:52.031538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:52.041621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 951/1896] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:52.046080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d1ae-6749-42d3-9b64-4b81aae38c0a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:52.056381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7d1ae-6749-42d3-9b64-4b81aae38c0a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:52.061795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7b78-42ea-4d11-80cf-48e1433d46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:52.062397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7b78-42ea-4d11-80cf-48e1433d46f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.062680 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7b78-42ea-4d11-80cf-48e1433d46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.062954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7b78-42ea-4d11-80cf-48e1433d46f2 admin admin] PATH_INFO: `/v3/projects/6dba76c16a84470db3c1fd7449751cd9/users/17807c676111466c930963591fc5e221/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.064931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7b78-42ea-4d11-80cf-48e1433d46f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dba76c16a84470db3c1fd7449751cd9, user_id=17807c676111466c930963591fc5e221, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:52.067621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7b78-42ea-4d11-80cf-48e1433d46f2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:52.079357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 946/1897] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:50:52 2022] PUT /identity/v3/projects/6dba76c16a84470db3c1fd7449751cd9/users/17807c676111466c930963591fc5e221/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:52.090305 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844eb73-e187-4a7a-8b9d-f769db11c170 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.090626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844eb73-e187-4a7a-8b9d-f769db11c170 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.090906 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844eb73-e187-4a7a-8b9d-f769db11c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.117697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c844eb73-e187-4a7a-8b9d-f769db11c170 None None] MFA Rules not processed for user `17807c676111466c930963591fc5e221`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:52.118951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c844eb73-e187-4a7a-8b9d-f769db11c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:52.190921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 952/1898] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:50:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:50:52.202722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7b78-42ea-4d11-80cf-48e1433d46f2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:52.204439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e12e7b78-42ea-4d11-80cf-48e1433d46f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:52.263588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7b78-42ea-4d11-80cf-48e1433d46f2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:52.268069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c18cc-1c25-4f3e-bf72-afa824fef92f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:52.268719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c18cc-1c25-4f3e-bf72-afa824fef92f service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.269000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c18cc-1c25-4f3e-bf72-afa824fef92f service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.269277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c18cc-1c25-4f3e-bf72-afa824fef92f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.278863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c18cc-1c25-4f3e-bf72-afa824fef92f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:52.281505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c18cc-1c25-4f3e-bf72-afa824fef92f service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:52.294398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 947/1899] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:50:52.379030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844eb73-e187-4a7a-8b9d-f769db11c170 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:52.380792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c844eb73-e187-4a7a-8b9d-f769db11c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:52.400513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844eb73-e187-4a7a-8b9d-f769db11c170 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:52.402580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e6be1-1a39-44d3-afb4-b56b350f6a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:52.403233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e6be1-1a39-44d3-afb4-b56b350f6a58 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.403516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e6be1-1a39-44d3-afb4-b56b350f6a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.403788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e6be1-1a39-44d3-afb4-b56b350f6a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.482435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e6be1-1a39-44d3-afb4-b56b350f6a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:52.484790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e6be1-1a39-44d3-afb4-b56b350f6a58 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:52.502559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 953/1900] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:50:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:02.288107 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=42,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:02.495481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=64 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:04.300349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c18cc-1c25-4f3e-bf72-afa824fef92f service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:04.301850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-401c18cc-1c25-4f3e-bf72-afa824fef92f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:04.387574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c18cc-1c25-4f3e-bf72-afa824fef92f service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:04.394116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:04.395053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.395332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.395632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] PATH_INFO: `/v3/users/4c353419914a416da0682b5b77724ae1` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.396858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c353419914a416da0682b5b77724ae1)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:04.399120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:04.456624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c353419914a416da0682b5b77724ae1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:04.457407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c353419914a416da0682b5b77724ae1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:04.472790 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c353419914a416da0682b5b77724ae1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:04.485395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c353419914a416da0682b5b77724ae1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:04.500323 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-25a57f8d-fbe6-4218-a187-bd787d5fc2bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c353419914a416da0682b5b77724ae1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:04.510634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 948/1901] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:04 2022] DELETE /identity/v3/users/4c353419914a416da0682b5b77724ae1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:04.512333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa6cd-091a-44f2-ad8a-2b0f3965d051 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.512784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa6cd-091a-44f2-ad8a-2b0f3965d051 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.512976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa6cd-091a-44f2-ad8a-2b0f3965d051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.553512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46833179-1fcf-41a7-96f0-be97b0dfa44b None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.554138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46833179-1fcf-41a7-96f0-be97b0dfa44b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.554626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46833179-1fcf-41a7-96f0-be97b0dfa44b None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.556577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 949/1902] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:51:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:04.573044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e70aa6cd-091a-44f2-ad8a-2b0f3965d051 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:04.574288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e70aa6cd-091a-44f2-ad8a-2b0f3965d051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:04.601078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dddb0e-cc97-43b0-9045-6607d06c7a59 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.601584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dddb0e-cc97-43b0-9045-6607d06c7a59 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.602503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dddb0e-cc97-43b0-9045-6607d06c7a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.628839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b0dddb0e-cc97-43b0-9045-6607d06c7a59 None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:04.630404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b0dddb0e-cc97-43b0-9045-6607d06c7a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:04.782241 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 954/1903] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:04.789514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa6cd-091a-44f2-ad8a-2b0f3965d051 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:04.797757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 950/1904] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:51:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:04.798600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e70aa6cd-091a-44f2-ad8a-2b0f3965d051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:04.880435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa6cd-091a-44f2-ad8a-2b0f3965d051 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:04.885033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ce81-338d-4fe1-9ba3-718bbc460c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:04.885710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ce81-338d-4fe1-9ba3-718bbc460c64 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.885986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ce81-338d-4fe1-9ba3-718bbc460c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.886262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ce81-338d-4fe1-9ba3-718bbc460c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.899433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6ce81-338d-4fe1-9ba3-718bbc460c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:04.900994 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6ce81-338d-4fe1-9ba3-718bbc460c64 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:04.922209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 955/1905] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:05.215622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dddb0e-cc97-43b0-9045-6607d06c7a59 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:05.218502 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b0dddb0e-cc97-43b0-9045-6607d06c7a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:05.241231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dddb0e-cc97-43b0-9045-6607d06c7a59 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:05.251673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36cf20-b21f-48a0-8217-05e7aec53eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:05.252345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36cf20-b21f-48a0-8217-05e7aec53eea service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:05.252681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36cf20-b21f-48a0-8217-05e7aec53eea service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:05.253056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36cf20-b21f-48a0-8217-05e7aec53eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:05.269168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36cf20-b21f-48a0-8217-05e7aec53eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:05.271919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36cf20-b21f-48a0-8217-05e7aec53eea service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:05.278162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:05.290168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 951/1906] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:05.391461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ce81-338d-4fe1-9ba3-718bbc460c64 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:05.393072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9fb6ce81-338d-4fe1-9ba3-718bbc460c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:05.414003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ce81-338d-4fe1-9ba3-718bbc460c64 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:05.420937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:05.422220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:05.422691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:05.423139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] PATH_INFO: `/v3/projects/60ac3465eaa142b78c8b4f08da777e0d` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:05.424462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ac3465eaa142b78c8b4f08da777e0d)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:05.426479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:05.473352 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ac3465eaa142b78c8b4f08da777e0d', 'request_id': 'req-33965a44-fc0c-454b-9a05-8dd07de78f6c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.480545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ac3465eaa142b78c8b4f08da777e0d', 'request_id': 'req-33965a44-fc0c-454b-9a05-8dd07de78f6c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.487472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ac3465eaa142b78c8b4f08da777e0d', 'request_id': 'req-33965a44-fc0c-454b-9a05-8dd07de78f6c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.497578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] The token cache is being invalidate because project 60ac3465eaa142b78c8b4f08da777e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:05.497918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.498600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.500139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 956/1907] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:05 2022] DELETE /identity/v3/projects/60ac3465eaa142b78c8b4f08da777e0d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:05.504226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36cf20-b21f-48a0-8217-05e7aec53eea service nova] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:05.514928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36cf20-b21f-48a0-8217-05e7aec53eea service nova] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:05.573091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:05.573969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:05.574248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:05.574567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] PATH_INFO: `/v3/users/5fb99d1ea4b94faab2ae475f8f76a44b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:05.575787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb99d1ea4b94faab2ae475f8f76a44b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:05.577774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:05.625063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb99d1ea4b94faab2ae475f8f76a44b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.625737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb99d1ea4b94faab2ae475f8f76a44b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.638368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb99d1ea4b94faab2ae475f8f76a44b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.645336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb99d1ea4b94faab2ae475f8f76a44b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.652733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-43a7dc3a-0fe2-4683-a1fb-2b10a2227478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb99d1ea4b94faab2ae475f8f76a44b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:05.659288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 952/1908] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:05 2022] DELETE /identity/v3/users/5fb99d1ea4b94faab2ae475f8f76a44b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:05.935776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:05.937606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:05.983289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33965a44-fc0c-454b-9a05-8dd07de78f6c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:06.057416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:06.120445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:06.121920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.123949 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.124509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] PATH_INFO: `/v3/projects/b99c0187474f4925b7c0133b10ab3701` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.127062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99c0187474f4925b7c0133b10ab3701)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:06.134364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:06.214208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99c0187474f4925b7c0133b10ab3701', 'request_id': 'req-7e99d2db-c732-44e0-9959-7ced646dff8e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:06.238214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99c0187474f4925b7c0133b10ab3701', 'request_id': 'req-7e99d2db-c732-44e0-9959-7ced646dff8e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:06.249272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99c0187474f4925b7c0133b10ab3701', 'request_id': 'req-7e99d2db-c732-44e0-9959-7ced646dff8e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:06.263424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] The token cache is being invalidate because project b99c0187474f4925b7c0133b10ab3701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:06.264671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:06.265762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7e99d2db-c732-44e0-9959-7ced646dff8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:06.268659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 957/1909] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:05 2022] DELETE /identity/v3/projects/b99c0187474f4925b7c0133b10ab3701 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:06.282886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e30b8-c122-40ae-aae8-c20791dceba4 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.282886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e30b8-c122-40ae-aae8-c20791dceba4 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.282886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e30b8-c122-40ae-aae8-c20791dceba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.295823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d94e30b8-c122-40ae-aae8-c20791dceba4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:06.297264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d94e30b8-c122-40ae-aae8-c20791dceba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:06.438615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 953/1910] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:06.439765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a660ec-f463-414d-8c1e-8ad13987aadc None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.440257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a660ec-f463-414d-8c1e-8ad13987aadc None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.440738 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a660ec-f463-414d-8c1e-8ad13987aadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.475430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d3a660ec-f463-414d-8c1e-8ad13987aadc None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:06.479298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d3a660ec-f463-414d-8c1e-8ad13987aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:06.502133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 958/1911] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:06.506550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e30b8-c122-40ae-aae8-c20791dceba4 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:06.553404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e30b8-c122-40ae-aae8-c20791dceba4 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:06.571508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb549d4-2e7c-4089-bc8a-bd1b690a5fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:06.572745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb549d4-2e7c-4089-bc8a-bd1b690a5fac admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.573183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb549d4-2e7c-4089-bc8a-bd1b690a5fac admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.573736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb549d4-2e7c-4089-bc8a-bd1b690a5fac admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.574681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb549d4-2e7c-4089-bc8a-bd1b690a5fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:06.575150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb549d4-2e7c-4089-bc8a-bd1b690a5fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:06.577231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb549d4-2e7c-4089-bc8a-bd1b690a5fac admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:06.604812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 954/1912] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:06.608265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a660ec-f463-414d-8c1e-8ad13987aadc None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:06.619748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a660ec-f463-414d-8c1e-8ad13987aadc None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:06.636804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740587a5-6e23-4c8c-8d18-245df4644c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:06.637768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740587a5-6e23-4c8c-8d18-245df4644c1b admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.638496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740587a5-6e23-4c8c-8d18-245df4644c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.639886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740587a5-6e23-4c8c-8d18-245df4644c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.647313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740587a5-6e23-4c8c-8d18-245df4644c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:06.656882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740587a5-6e23-4c8c-8d18-245df4644c1b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:06.716836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 959/1913] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:06 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:06.718436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb549d4-2e7c-4089-bc8a-bd1b690a5fac admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:06.729710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:06.736500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb549d4-2e7c-4089-bc8a-bd1b690a5fac admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:06.869166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb64a9-b90b-49ff-9780-e3df44d51247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:06.869940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb64a9-b90b-49ff-9780-e3df44d51247 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.870182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb64a9-b90b-49ff-9780-e3df44d51247 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.870489 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb64a9-b90b-49ff-9780-e3df44d51247 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.871341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb64a9-b90b-49ff-9780-e3df44d51247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:06.877683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb64a9-b90b-49ff-9780-e3df44d51247 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:06.931595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 955/1914] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:06 2022] POST /identity/v3/users => generated 295 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:06.937164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740587a5-6e23-4c8c-8d18-245df4644c1b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:06.965456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740587a5-6e23-4c8c-8d18-245df4644c1b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:06.981107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f36ba5-7c98-43f3-a55b-e0591455117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:06.985265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f36ba5-7c98-43f3-a55b-e0591455117b admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.985580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f36ba5-7c98-43f3-a55b-e0591455117b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.985868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f36ba5-7c98-43f3-a55b-e0591455117b admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.988484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f36ba5-7c98-43f3-a55b-e0591455117b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:06.994480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f36ba5-7c98-43f3-a55b-e0591455117b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.016221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb64a9-b90b-49ff-9780-e3df44d51247 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.017151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 960/1915] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:07.033143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb64a9-b90b-49ff-9780-e3df44d51247 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.038706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275e221-9c85-4633-b0e6-a0a2b24d7a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.039895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275e221-9c85-4633-b0e6-a0a2b24d7a03 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.041583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275e221-9c85-4633-b0e6-a0a2b24d7a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.041583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275e221-9c85-4633-b0e6-a0a2b24d7a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.042127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275e221-9c85-4633-b0e6-a0a2b24d7a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.043853 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275e221-9c85-4633-b0e6-a0a2b24d7a03 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.064776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f36ba5-7c98-43f3-a55b-e0591455117b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.065093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 956/1916] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:07.080875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f36ba5-7c98-43f3-a55b-e0591455117b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.087989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b558d3-ebed-4a3c-8b69-84c2df0b4a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.089522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b558d3-ebed-4a3c-8b69-84c2df0b4a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.090156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b558d3-ebed-4a3c-8b69-84c2df0b4a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.090813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b558d3-ebed-4a3c-8b69-84c2df0b4a5f admin admin] PATH_INFO: `/v3/projects/6755220ea166432da745970dab0d7aa0/users/06c65d20ed314a7b931625092676b777/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.116379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b558d3-ebed-4a3c-8b69-84c2df0b4a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6755220ea166432da745970dab0d7aa0, user_id=06c65d20ed314a7b931625092676b777, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.120571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b558d3-ebed-4a3c-8b69-84c2df0b4a5f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.142470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 961/1917] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:07 2022] PUT /identity/v3/projects/6755220ea166432da745970dab0d7aa0/users/06c65d20ed314a7b931625092676b777/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:07.151027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f9d1-4cf8-4598-ac65-8144a174515f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.151571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f9d1-4cf8-4598-ac65-8144a174515f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.152091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f9d1-4cf8-4598-ac65-8144a174515f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.188059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-1120f9d1-4cf8-4598-ac65-8144a174515f None None] MFA Rules not processed for user `06c65d20ed314a7b931625092676b777`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:07.190132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1120f9d1-4cf8-4598-ac65-8144a174515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:07.273692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 957/1918] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:07.277965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b558d3-ebed-4a3c-8b69-84c2df0b4a5f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.335776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:07.352743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b558d3-ebed-4a3c-8b69-84c2df0b4a5f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.359297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e97b6-3a55-430d-8d33-3dfdd5bf2d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.360702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e97b6-3a55-430d-8d33-3dfdd5bf2d33 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.360984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e97b6-3a55-430d-8d33-3dfdd5bf2d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.361617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e97b6-3a55-430d-8d33-3dfdd5bf2d33 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.362468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e97b6-3a55-430d-8d33-3dfdd5bf2d33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.365374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e97b6-3a55-430d-8d33-3dfdd5bf2d33 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.410373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 962/1919] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:07 2022] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:07.412235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f9d1-4cf8-4598-ac65-8144a174515f None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.431365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f9d1-4cf8-4598-ac65-8144a174515f None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.566971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57130e3c-fa4c-444a-a764-b6a4f41452f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.570595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57130e3c-fa4c-444a-a764-b6a4f41452f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.571129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57130e3c-fa4c-444a-a764-b6a4f41452f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.571549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57130e3c-fa4c-444a-a764-b6a4f41452f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.572961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57130e3c-fa4c-444a-a764-b6a4f41452f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.577305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57130e3c-fa4c-444a-a764-b6a4f41452f1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.612276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 958/1920] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:07 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:07.615881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e97b6-3a55-430d-8d33-3dfdd5bf2d33 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.631111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e97b6-3a55-430d-8d33-3dfdd5bf2d33 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.647703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0872b-1fa0-464d-a0e7-d3654b942293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.648401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0872b-1fa0-464d-a0e7-d3654b942293 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.648683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0872b-1fa0-464d-a0e7-d3654b942293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.649016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0872b-1fa0-464d-a0e7-d3654b942293 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.649688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0872b-1fa0-464d-a0e7-d3654b942293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.651346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0872b-1fa0-464d-a0e7-d3654b942293 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.674034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 963/1921] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:07.678339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57130e3c-fa4c-444a-a764-b6a4f41452f1 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.683939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:07.692575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57130e3c-fa4c-444a-a764-b6a4f41452f1 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.707130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44c048-9d4d-49cf-9a08-59c5d2b548e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.708120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44c048-9d4d-49cf-9a08-59c5d2b548e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.708482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44c048-9d4d-49cf-9a08-59c5d2b548e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.708764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44c048-9d4d-49cf-9a08-59c5d2b548e7 admin admin] PATH_INFO: `/v3/projects/b9a72ff6cbf942b59130ebdfa9fd69be/users/2465da8f777b4c9f83450188b6f2986b/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.764550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44c048-9d4d-49cf-9a08-59c5d2b548e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a72ff6cbf942b59130ebdfa9fd69be, user_id=2465da8f777b4c9f83450188b6f2986b, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.767570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44c048-9d4d-49cf-9a08-59c5d2b548e7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.795607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0872b-1fa0-464d-a0e7-d3654b942293 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.796073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 959/1922] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:07 2022] PUT /identity/v3/projects/b9a72ff6cbf942b59130ebdfa9fd69be/users/2465da8f777b4c9f83450188b6f2986b/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:07.811621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0872b-1fa0-464d-a0e7-d3654b942293 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.885477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7ebec-90c8-476e-a425-f9194444b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.886179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7ebec-90c8-476e-a425-f9194444b3fd admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.886373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7ebec-90c8-476e-a425-f9194444b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.886650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7ebec-90c8-476e-a425-f9194444b3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.887378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7ebec-90c8-476e-a425-f9194444b3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.890493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7ebec-90c8-476e-a425-f9194444b3fd admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.901755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 964/1923] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:07.906282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44c048-9d4d-49cf-9a08-59c5d2b548e7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.917194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44c048-9d4d-49cf-9a08-59c5d2b548e7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.922213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16e489-be62-4705-b0a0-6cd4266c3b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.923146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16e489-be62-4705-b0a0-6cd4266c3b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.923431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16e489-be62-4705-b0a0-6cd4266c3b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.923711 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16e489-be62-4705-b0a0-6cd4266c3b97 admin admin] PATH_INFO: `/v3/projects/b9a72ff6cbf942b59130ebdfa9fd69be/users/2465da8f777b4c9f83450188b6f2986b/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.925768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16e489-be62-4705-b0a0-6cd4266c3b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a72ff6cbf942b59130ebdfa9fd69be, user_id=2465da8f777b4c9f83450188b6f2986b, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.928455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16e489-be62-4705-b0a0-6cd4266c3b97 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.957834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 960/1924] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:07 2022] PUT /identity/v3/projects/b9a72ff6cbf942b59130ebdfa9fd69be/users/2465da8f777b4c9f83450188b6f2986b/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:07.970148 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda0a1d-4b4b-4541-a1f5-79f6a9855373 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.970709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda0a1d-4b4b-4541-a1f5-79f6a9855373 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.970876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda0a1d-4b4b-4541-a1f5-79f6a9855373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.997851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16e489-be62-4705-b0a0-6cd4266c3b97 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.999824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0e16e489-be62-4705-b0a0-6cd4266c3b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.005237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ceda0a1d-4b4b-4541-a1f5-79f6a9855373 None None] MFA Rules not processed for user `2465da8f777b4c9f83450188b6f2986b`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:08.006516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ceda0a1d-4b4b-4541-a1f5-79f6a9855373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.112280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16e489-be62-4705-b0a0-6cd4266c3b97 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:08.118193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:08.119398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:08.120037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:08.120382 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] PATH_INFO: `/v3/users/851eecb7b6ac4b559e79d920dc0fe30b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:08.121670 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] RBAC: Authorizing `identity:delete_user(user_id=851eecb7b6ac4b559e79d920dc0fe30b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:08.124835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:08.161989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 965/1925] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:08.175342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda0a1d-4b4b-4541-a1f5-79f6a9855373 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:08.176958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ceda0a1d-4b4b-4541-a1f5-79f6a9855373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.225043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851eecb7b6ac4b559e79d920dc0fe30b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.225974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851eecb7b6ac4b559e79d920dc0fe30b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.240298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851eecb7b6ac4b559e79d920dc0fe30b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.246812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:08.247573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851eecb7b6ac4b559e79d920dc0fe30b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.252199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda0a1d-4b4b-4541-a1f5-79f6a9855373 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:08.257219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e0919000-6922-4dd0-b29a-35bce494213e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851eecb7b6ac4b559e79d920dc0fe30b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.257348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:08.258053 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:08.258801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:08.259130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:08.261855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.265594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 961/1926] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:07 2022] DELETE /identity/v3/users/851eecb7b6ac4b559e79d920dc0fe30b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:08.270164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bd12-2a98-4077-a0be-18adbee17fe8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:08.270493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bd12-2a98-4077-a0be-18adbee17fe8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:08.270776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bd12-2a98-4077-a0be-18adbee17fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:08.280647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:08.280647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:08.290044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-6823bd12-2a98-4077-a0be-18adbee17fe8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:08.290454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 966/1927] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:08.291397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6823bd12-2a98-4077-a0be-18adbee17fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.349702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:08.379186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 962/1928] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:08.391243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:08.392757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.445600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823bd12-2a98-4077-a0be-18adbee17fe8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:08.447697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6823bd12-2a98-4077-a0be-18adbee17fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.455883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3a15a-e8a9-4fa5-93e4-7e6eb03954f8 service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:08.461452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823bd12-2a98-4077-a0be-18adbee17fe8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:08.466635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:08.467665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:08.467949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:08.468237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] PATH_INFO: `/v3/users/06c65d20ed314a7b931625092676b777` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:08.469645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c65d20ed314a7b931625092676b777)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:08.471848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:08.542521 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c65d20ed314a7b931625092676b777'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.543046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c65d20ed314a7b931625092676b777'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.547392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:08.548077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:08.548365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:08.548647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:08.551065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.559247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c65d20ed314a7b931625092676b777'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.567841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c65d20ed314a7b931625092676b777'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.568651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:08.570232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:08.577050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cd54d3a3-914e-4566-89cb-d8d066c20365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c65d20ed314a7b931625092676b777'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:08.584620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 963/1929] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:08 2022] DELETE /identity/v3/users/06c65d20ed314a7b931625092676b777 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:08.589697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e72dc-f5ae-40a9-90e3-92dae761799a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:08.589993 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e72dc-f5ae-40a9-90e3-92dae761799a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:08.590372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e72dc-f5ae-40a9-90e3-92dae761799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:08.595743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 967/1930] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:08.609639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-497e72dc-f5ae-40a9-90e3-92dae761799a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:08.610904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-497e72dc-f5ae-40a9-90e3-92dae761799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.686797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 964/1931] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:08.696508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:08.698468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:08.710769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99083d-f9e0-4123-9b6e-511ac6faf27e service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:08.765840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5b59f-c714-4d89-ac48-cae2f2cdbe7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:08.766717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b59f-c714-4d89-ac48-cae2f2cdbe7d service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:08.767672 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b59f-c714-4d89-ac48-cae2f2cdbe7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:08.767672 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b59f-c714-4d89-ac48-cae2f2cdbe7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:08.777921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5b59f-c714-4d89-ac48-cae2f2cdbe7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:08.781252 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5b59f-c714-4d89-ac48-cae2f2cdbe7d service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:08.793867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 968/1932] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:09.027138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e72dc-f5ae-40a9-90e3-92dae761799a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:09.033135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-497e72dc-f5ae-40a9-90e3-92dae761799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:09.055782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e72dc-f5ae-40a9-90e3-92dae761799a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:09.067624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:09.068511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:09.068795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:09.069063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] PATH_INFO: `/v3/projects/920ace146a4844c4ada41fbfc6fbc780` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:09.070824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920ace146a4844c4ada41fbfc6fbc780)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:09.073066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:09.150599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920ace146a4844c4ada41fbfc6fbc780', 'request_id': 'req-01e92ddd-5044-459e-8dbe-3851a8d419c2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.157084 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:09.165256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920ace146a4844c4ada41fbfc6fbc780', 'request_id': 'req-01e92ddd-5044-459e-8dbe-3851a8d419c2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.176890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920ace146a4844c4ada41fbfc6fbc780', 'request_id': 'req-01e92ddd-5044-459e-8dbe-3851a8d419c2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.203955 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] The token cache is being invalidate because project 920ace146a4844c4ada41fbfc6fbc780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:09.204507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.205320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.207529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 965/1933] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:09 2022] DELETE /identity/v3/projects/920ace146a4844c4ada41fbfc6fbc780 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:09.211644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5b59f-c714-4d89-ac48-cae2f2cdbe7d service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:09.222777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5b59f-c714-4d89-ac48-cae2f2cdbe7d service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:09.274079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:09.284363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:09.285270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:09.285554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:09.285851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] PATH_INFO: `/v3/users/17807c676111466c930963591fc5e221` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:09.287066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17807c676111466c930963591fc5e221)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:09.288986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:09.336821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17807c676111466c930963591fc5e221'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.337483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17807c676111466c930963591fc5e221'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.339661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17807c676111466c930963591fc5e221'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.363108 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17807c676111466c930963591fc5e221'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.364927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17807c676111466c930963591fc5e221'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.380661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 969/1934] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:09 2022] DELETE /identity/v3/users/17807c676111466c930963591fc5e221 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:51:09.624687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:09.626731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:09.646979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e92ddd-5044-459e-8dbe-3851a8d419c2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:09.763130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:09.764843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:09.765282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:09.765659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] PATH_INFO: `/v3/projects/6755220ea166432da745970dab0d7aa0` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:09.768554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6755220ea166432da745970dab0d7aa0)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:09.771853 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:09.844774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:09.847624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:09.865012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b621dcf-fcad-44eb-8532-04d8e1d90a63 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:09.877503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6755220ea166432da745970dab0d7aa0', 'request_id': 'req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.886577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6755220ea166432da745970dab0d7aa0', 'request_id': 'req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.895086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6755220ea166432da745970dab0d7aa0', 'request_id': 'req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.907721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] The token cache is being invalidate because project 6755220ea166432da745970dab0d7aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:09.908021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.908677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.910536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 966/1935] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:09 2022] DELETE /identity/v3/projects/6755220ea166432da745970dab0d7aa0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:09.914109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:09.915462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:09.933805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:09.934700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:09.934990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:09.935796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] PATH_INFO: `/v3/projects/6dba76c16a84470db3c1fd7449751cd9` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:09.937623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dba76c16a84470db3c1fd7449751cd9)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:09.939600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:09.982430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db37c7-8e3b-4e8d-a941-7c00f9ca5e77 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:09.986844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dba76c16a84470db3c1fd7449751cd9', 'request_id': 'req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.994229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dba76c16a84470db3c1fd7449751cd9', 'request_id': 'req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:09.995588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:10.011662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dba76c16a84470db3c1fd7449751cd9', 'request_id': 'req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.025473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] The token cache is being invalidate because project 6dba76c16a84470db3c1fd7449751cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:10.025774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.026482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-37fd05f6-26b0-4648-87fc-e8d04c8c6df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.028337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 970/1936] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:09 2022] DELETE /identity/v3/projects/6dba76c16a84470db3c1fd7449751cd9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:10.033140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63804ae9-ab90-4bff-b0b4-1869091640ea None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.033435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63804ae9-ab90-4bff-b0b4-1869091640ea None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.033722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63804ae9-ab90-4bff-b0b4-1869091640ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.040611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:10.050617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.051728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.052216 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.052695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] PATH_INFO: `/v3/users/2465da8f777b4c9f83450188b6f2986b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.054156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2465da8f777b4c9f83450188b6f2986b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.055324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-63804ae9-ab90-4bff-b0b4-1869091640ea None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:10.056246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.056699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-63804ae9-ab90-4bff-b0b4-1869091640ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:10.066750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 971/1937] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:10.074622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990060-d399-46c4-8302-c825aa30bf34 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.074917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990060-d399-46c4-8302-c825aa30bf34 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.075202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3990060-d399-46c4-8302-c825aa30bf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.099836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d3990060-d399-46c4-8302-c825aa30bf34 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:10.101075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d3990060-d399-46c4-8302-c825aa30bf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:10.109777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 972/1938] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:10.114297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3990060-d399-46c4-8302-c825aa30bf34 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.120825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2465da8f777b4c9f83450188b6f2986b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.121641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2465da8f777b4c9f83450188b6f2986b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.124933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3990060-d399-46c4-8302-c825aa30bf34 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.129653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.130310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.130646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.130924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.131799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:10.132107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.133831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.152072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 973/1939] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:10.156763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.157703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2465da8f777b4c9f83450188b6f2986b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.159443 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:10.170408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2465da8f777b4c9f83450188b6f2986b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.175555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561811-d9fa-4f09-9a81-6bd5320cb4ab admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.180948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fc634-154c-4da8-9891-b721b0dc610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.181647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fc634-154c-4da8-9891-b721b0dc610e admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.181762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2465da8f777b4c9f83450188b6f2986b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.181937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fc634-154c-4da8-9891-b721b0dc610e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.182256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fc634-154c-4da8-9891-b721b0dc610e admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.183084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fc634-154c-4da8-9891-b721b0dc610e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.185093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fc634-154c-4da8-9891-b721b0dc610e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.202234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 967/1940] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:09 2022] DELETE /identity/v3/users/2465da8f777b4c9f83450188b6f2986b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:51:10.219669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 974/1941] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:10 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:10.223911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.306413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec28b6-cf28-4faa-bccb-c83f1f774a23 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.357580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:10.374333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d3019-d032-426f-aa4f-ea9fc38b9dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.375036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d3019-d032-426f-aa4f-ea9fc38b9dca admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.375324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d3019-d032-426f-aa4f-ea9fc38b9dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.375663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d3019-d032-426f-aa4f-ea9fc38b9dca admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.376372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d3019-d032-426f-aa4f-ea9fc38b9dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.378958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d3019-d032-426f-aa4f-ea9fc38b9dca admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.406063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 968/1942] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:10 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:10.410154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fc634-154c-4da8-9891-b721b0dc610e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.420570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fc634-154c-4da8-9891-b721b0dc610e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.426429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99186b2e-541a-474f-a237-f72d1094267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.427495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99186b2e-541a-474f-a237-f72d1094267e admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.427793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99186b2e-541a-474f-a237-f72d1094267e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.428075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99186b2e-541a-474f-a237-f72d1094267e admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.428839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99186b2e-541a-474f-a237-f72d1094267e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.430496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99186b2e-541a-474f-a237-f72d1094267e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.442383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 975/1943] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:51:10.445535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d3019-d032-426f-aa4f-ea9fc38b9dca admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.457070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d3019-d032-426f-aa4f-ea9fc38b9dca admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.462675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc973b-a301-44f4-9f40-7cca7d89d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.463347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc973b-a301-44f4-9f40-7cca7d89d586 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.463630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc973b-a301-44f4-9f40-7cca7d89d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.463910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc973b-a301-44f4-9f40-7cca7d89d586 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.464637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc973b-a301-44f4-9f40-7cca7d89d586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.466233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc973b-a301-44f4-9f40-7cca7d89d586 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.478351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 969/1944] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:10.481648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99186b2e-541a-474f-a237-f72d1094267e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.492575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99186b2e-541a-474f-a237-f72d1094267e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.497202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3602393-0e2d-45a1-9c33-462dbc7df153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.499666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3602393-0e2d-45a1-9c33-462dbc7df153 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.499942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3602393-0e2d-45a1-9c33-462dbc7df153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.500213 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3602393-0e2d-45a1-9c33-462dbc7df153 admin admin] PATH_INFO: `/v3/projects/01d9d47d55114ccfb895c184b0f2d0b2/users/5c95191527974e7a8bfb88db0a6a87fe/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.516010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3602393-0e2d-45a1-9c33-462dbc7df153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d9d47d55114ccfb895c184b0f2d0b2, user_id=5c95191527974e7a8bfb88db0a6a87fe, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.522342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3602393-0e2d-45a1-9c33-462dbc7df153 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.550400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 976/1945] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:10 2022] PUT /identity/v3/projects/01d9d47d55114ccfb895c184b0f2d0b2/users/5c95191527974e7a8bfb88db0a6a87fe/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:10.557690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc973b-a301-44f4-9f40-7cca7d89d586 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.559783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ccfc973b-a301-44f4-9f40-7cca7d89d586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:10.560653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57d966-3811-4432-a4c2-108675824cc1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.561600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57d966-3811-4432-a4c2-108675824cc1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.561905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57d966-3811-4432-a4c2-108675824cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.574351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc973b-a301-44f4-9f40-7cca7d89d586 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.596362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-6b57d966-3811-4432-a4c2-108675824cc1 None None] MFA Rules not processed for user `5c95191527974e7a8bfb88db0a6a87fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:10.598515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6b57d966-3811-4432-a4c2-108675824cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:10.660863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.662364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.662828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.663281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] PATH_INFO: `/v3/projects/b9a72ff6cbf942b59130ebdfa9fd69be` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.664848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a72ff6cbf942b59130ebdfa9fd69be)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.667020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.704019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 977/1946] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:10.709326 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57d966-3811-4432-a4c2-108675824cc1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.726507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57d966-3811-4432-a4c2-108675824cc1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.731623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a72ff6cbf942b59130ebdfa9fd69be', 'request_id': 'req-83e7235c-e66a-4422-a4de-5cacaa94204c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.741888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a72ff6cbf942b59130ebdfa9fd69be', 'request_id': 'req-83e7235c-e66a-4422-a4de-5cacaa94204c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.754634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a72ff6cbf942b59130ebdfa9fd69be', 'request_id': 'req-83e7235c-e66a-4422-a4de-5cacaa94204c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.780148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] The token cache is being invalidate because project b9a72ff6cbf942b59130ebdfa9fd69be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:10.780608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.781296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-83e7235c-e66a-4422-a4de-5cacaa94204c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:10.782932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 970/1947] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:10 2022] DELETE /identity/v3/projects/b9a72ff6cbf942b59130ebdfa9fd69be => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:51:10.788545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97434680-5228-4d56-9155-b1f5d6e2c9b5 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.788949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97434680-5228-4d56-9155-b1f5d6e2c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.789332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97434680-5228-4d56-9155-b1f5d6e2c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.809667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-97434680-5228-4d56-9155-b1f5d6e2c9b5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:10.811794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-97434680-5228-4d56-9155-b1f5d6e2c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:10.829096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd4c8a-9b88-4f3a-87fd-6d2a510b225d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.830110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd4c8a-9b88-4f3a-87fd-6d2a510b225d admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.830434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd4c8a-9b88-4f3a-87fd-6d2a510b225d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.830716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd4c8a-9b88-4f3a-87fd-6d2a510b225d admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.831657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd4c8a-9b88-4f3a-87fd-6d2a510b225d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.833728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd4c8a-9b88-4f3a-87fd-6d2a510b225d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.836799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 971/1948] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:10.849115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:10.850163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb2b38-2908-4436-b15a-f1888b07040d None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.850495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb2b38-2908-4436-b15a-f1888b07040d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.850769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb2b38-2908-4436-b15a-f1888b07040d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.874161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 978/1949] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:10 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:10.877995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd4c8a-9b88-4f3a-87fd-6d2a510b225d admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.879742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-cefb2b38-2908-4436-b15a-f1888b07040d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:10.880335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-03dd4c8a-9b88-4f3a-87fd-6d2a510b225d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:10.881163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-cefb2b38-2908-4436-b15a-f1888b07040d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:10.940658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:10.976778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 972/1950] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:10.977782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb2b38-2908-4436-b15a-f1888b07040d None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:10.979758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd4c8a-9b88-4f3a-87fd-6d2a510b225d admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.986509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b3f2b-445e-45e2-839f-0bca2456c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.987174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b3f2b-445e-45e2-839f-0bca2456c366 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.987451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b3f2b-445e-45e2-839f-0bca2456c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.987725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b3f2b-445e-45e2-839f-0bca2456c366 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.988445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b3f2b-445e-45e2-839f-0bca2456c366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.989355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb2b38-2908-4436-b15a-f1888b07040d None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:10.990384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b3f2b-445e-45e2-839f-0bca2456c366 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:10.994014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125401b-6465-4dd3-9864-7e8082c910bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:10.994700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125401b-6465-4dd3-9864-7e8082c910bb admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:10.994985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125401b-6465-4dd3-9864-7e8082c910bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:10.995345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125401b-6465-4dd3-9864-7e8082c910bb admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:10.995978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125401b-6465-4dd3-9864-7e8082c910bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:10.996284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125401b-6465-4dd3-9864-7e8082c910bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:10.998776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a125401b-6465-4dd3-9864-7e8082c910bb admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.016127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 973/1951] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:11.021361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125401b-6465-4dd3-9864-7e8082c910bb admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.021944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 979/1952] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:10 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:11.026435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b3f2b-445e-45e2-839f-0bca2456c366 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.033933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125401b-6465-4dd3-9864-7e8082c910bb admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.039135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b3f2b-445e-45e2-839f-0bca2456c366 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.040660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ac189-ada4-4139-be74-31c4d322151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.041538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ac189-ada4-4139-be74-31c4d322151f admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.041897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ac189-ada4-4139-be74-31c4d322151f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.042197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ac189-ada4-4139-be74-31c4d322151f admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.043017 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ac189-ada4-4139-be74-31c4d322151f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.045385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ea883-4be1-44e6-99ed-cd67a5b22b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.046200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ac189-ada4-4139-be74-31c4d322151f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.046436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ea883-4be1-44e6-99ed-cd67a5b22b3c admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.046796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ea883-4be1-44e6-99ed-cd67a5b22b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.047143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ea883-4be1-44e6-99ed-cd67a5b22b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.047934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ea883-4be1-44e6-99ed-cd67a5b22b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.049532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ea883-4be1-44e6-99ed-cd67a5b22b3c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.063735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 980/1953] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:51:11.064762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ea883-4be1-44e6-99ed-cd67a5b22b3c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.075783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ea883-4be1-44e6-99ed-cd67a5b22b3c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.081745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3fa33-f347-4121-8831-675c914a2160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.082376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 974/1954] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:11 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:11.082741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3fa33-f347-4121-8831-675c914a2160 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.083306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3fa33-f347-4121-8831-675c914a2160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.083523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3fa33-f347-4121-8831-675c914a2160 admin admin] PATH_INFO: `/v3/projects/568eed56efcd4bad923f38dd1425b905/users/e66ceee3e15e4eaea315c31d081100a4/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.086659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ac189-ada4-4139-be74-31c4d322151f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.102051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3fa33-f347-4121-8831-675c914a2160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568eed56efcd4bad923f38dd1425b905, user_id=e66ceee3e15e4eaea315c31d081100a4, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.104783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3fa33-f347-4121-8831-675c914a2160 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.123167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 981/1955] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:11 2022] PUT /identity/v3/projects/568eed56efcd4bad923f38dd1425b905/users/e66ceee3e15e4eaea315c31d081100a4/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:11.127306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3fa33-f347-4121-8831-675c914a2160 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.172238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ac189-ada4-4139-be74-31c4d322151f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.209970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3fa33-f347-4121-8831-675c914a2160 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.222604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44bda-f0d1-4dd2-821a-f2c159243fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.224006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44bda-f0d1-4dd2-821a-f2c159243fcc admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.229907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44bda-f0d1-4dd2-821a-f2c159243fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.229907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c44bda-f0d1-4dd2-821a-f2c159243fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.230170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c44bda-f0d1-4dd2-821a-f2c159243fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.232994 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c44bda-f0d1-4dd2-821a-f2c159243fcc admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.252210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 982/1956] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:11.258595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44bda-f0d1-4dd2-821a-f2c159243fcc admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.262287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3ae37-d559-44cd-a321-fd10ce2cdf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.263286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3ae37-d559-44cd-a321-fd10ce2cdf77 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.263821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3ae37-d559-44cd-a321-fd10ce2cdf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.264375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3ae37-d559-44cd-a321-fd10ce2cdf77 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.265407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3ae37-d559-44cd-a321-fd10ce2cdf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.267496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3ae37-d559-44cd-a321-fd10ce2cdf77 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.268512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c44bda-f0d1-4dd2-821a-f2c159243fcc admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.274563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b1920-ca99-42b7-b380-a0091d49a7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.275470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1920-ca99-42b7-b380-a0091d49a7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.275812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1920-ca99-42b7-b380-a0091d49a7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.276331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b1920-ca99-42b7-b380-a0091d49a7ba admin admin] PATH_INFO: `/v3/projects/568eed56efcd4bad923f38dd1425b905/users/e66ceee3e15e4eaea315c31d081100a4/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.278645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b1920-ca99-42b7-b380-a0091d49a7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=568eed56efcd4bad923f38dd1425b905, user_id=e66ceee3e15e4eaea315c31d081100a4, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.282236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b1920-ca99-42b7-b380-a0091d49a7ba admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.295705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 975/1957] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:11 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:11.300129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3ae37-d559-44cd-a321-fd10ce2cdf77 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.302634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 983/1958] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:11 2022] PUT /identity/v3/projects/568eed56efcd4bad923f38dd1425b905/users/e66ceee3e15e4eaea315c31d081100a4/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:11.315999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5ee5-ddea-4523-aaed-9e528b156e78 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.316482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5ee5-ddea-4523-aaed-9e528b156e78 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.316911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b5ee5-ddea-4523-aaed-9e528b156e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.324859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3ae37-d559-44cd-a321-fd10ce2cdf77 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.353262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-b47b5ee5-ddea-4523-aaed-9e528b156e78 None None] MFA Rules not processed for user `e66ceee3e15e4eaea315c31d081100a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:11.354983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b47b5ee5-ddea-4523-aaed-9e528b156e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:11.382498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:11.390133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:11.415807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61852ca8-972d-4a06-a800-5a35487f1b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.417030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61852ca8-972d-4a06-a800-5a35487f1b29 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.417324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61852ca8-972d-4a06-a800-5a35487f1b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.417612 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61852ca8-972d-4a06-a800-5a35487f1b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.418539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61852ca8-972d-4a06-a800-5a35487f1b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.421341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61852ca8-972d-4a06-a800-5a35487f1b29 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.437750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 976/1959] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:11.441718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61852ca8-972d-4a06-a800-5a35487f1b29 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.457465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 984/1960] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:11.458685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61852ca8-972d-4a06-a800-5a35487f1b29 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.463577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15f9a-b990-4745-b407-95b966648bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.464238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15f9a-b990-4745-b407-95b966648bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.464521 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15f9a-b990-4745-b407-95b966648bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.464798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e15f9a-b990-4745-b407-95b966648bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.465547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e15f9a-b990-4745-b407-95b966648bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.468213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e15f9a-b990-4745-b407-95b966648bc3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.470115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b5ee5-ddea-4523-aaed-9e528b156e78 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.471838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b47b5ee5-ddea-4523-aaed-9e528b156e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:11.479297 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 977/1961] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:51:11.483902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15f9a-b990-4745-b407-95b966648bc3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.494622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e15f9a-b990-4745-b407-95b966648bc3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.500061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ab9f2-1ebe-473e-a966-a67f4010b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.500971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ab9f2-1ebe-473e-a966-a67f4010b473 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.501471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ab9f2-1ebe-473e-a966-a67f4010b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.501780 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ab9f2-1ebe-473e-a966-a67f4010b473 admin admin] PATH_INFO: `/v3/projects/4142ab366c2c48b498bd6481cc00f3d2/users/95436b40c91a4c75bbefdc3acf79cee3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.526910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ab9f2-1ebe-473e-a966-a67f4010b473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4142ab366c2c48b498bd6481cc00f3d2, user_id=95436b40c91a4c75bbefdc3acf79cee3, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.531573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ab9f2-1ebe-473e-a966-a67f4010b473 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.548209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b5ee5-ddea-4523-aaed-9e528b156e78 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.553283 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 978/1962] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:11 2022] PUT /identity/v3/projects/4142ab366c2c48b498bd6481cc00f3d2/users/95436b40c91a4c75bbefdc3acf79cee3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:11.573197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c4e2-0dbd-4fda-be0c-0f80dea43386 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.573422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c4e2-0dbd-4fda-be0c-0f80dea43386 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.573703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071c4e2-0dbd-4fda-be0c-0f80dea43386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.601257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3071c4e2-0dbd-4fda-be0c-0f80dea43386 None None] MFA Rules not processed for user `95436b40c91a4c75bbefdc3acf79cee3`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:11.602506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3071c4e2-0dbd-4fda-be0c-0f80dea43386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:11.602616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec644c8-08a6-426c-9759-fde2662c5143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.603261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec644c8-08a6-426c-9759-fde2662c5143 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.603549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec644c8-08a6-426c-9759-fde2662c5143 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.603862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec644c8-08a6-426c-9759-fde2662c5143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.677673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 979/1963] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:11.682037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec644c8-08a6-426c-9759-fde2662c5143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.683873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec644c8-08a6-426c-9759-fde2662c5143 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.691447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071c4e2-0dbd-4fda-be0c-0f80dea43386 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.693373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3071c4e2-0dbd-4fda-be0c-0f80dea43386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:11.695192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 985/1964] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:51:11.707488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071c4e2-0dbd-4fda-be0c-0f80dea43386 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.711277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5240a-885f-42fa-9657-df1531d874f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.712079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5240a-885f-42fa-9657-df1531d874f8 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.712368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5240a-885f-42fa-9657-df1531d874f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.712650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5240a-885f-42fa-9657-df1531d874f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.725235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5240a-885f-42fa-9657-df1531d874f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.726921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5240a-885f-42fa-9657-df1531d874f8 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.727908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec644c8-08a6-426c-9759-fde2662c5143 service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.739734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 980/1965] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:51:11.761948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5240a-885f-42fa-9657-df1531d874f8 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:11.769197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:11.822381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec644c8-08a6-426c-9759-fde2662c5143 service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.828211 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.829207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.829599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.829982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] PATH_INFO: `/v3/users/5c95191527974e7a8bfb88db0a6a87fe` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.838691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c95191527974e7a8bfb88db0a6a87fe)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.840757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.849517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5240a-885f-42fa-9657-df1531d874f8 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:11.858129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:11.860389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.860776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.861198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] PATH_INFO: `/v3/users/95436b40c91a4c75bbefdc3acf79cee3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.863023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95436b40c91a4c75bbefdc3acf79cee3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:11.865696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:11.903348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:11.918812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c95191527974e7a8bfb88db0a6a87fe'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:11.919525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c95191527974e7a8bfb88db0a6a87fe'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:11.920794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c95191527974e7a8bfb88db0a6a87fe'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:11.931507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95436b40c91a4c75bbefdc3acf79cee3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:11.932279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95436b40c91a4c75bbefdc3acf79cee3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:11.936918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c95191527974e7a8bfb88db0a6a87fe'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:11.947033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e408eb73-56b3-4cde-a064-faf4ecf1ab8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c95191527974e7a8bfb88db0a6a87fe'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:11.949114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95436b40c91a4c75bbefdc3acf79cee3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:11.963459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95436b40c91a4c75bbefdc3acf79cee3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:11.965638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 986/1966] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:11 2022] DELETE /identity/v3/users/5c95191527974e7a8bfb88db0a6a87fe => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:51:11.981070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db22aa-3256-4f83-b242-6320999a4623 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.983054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db22aa-3256-4f83-b242-6320999a4623 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.983424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db22aa-3256-4f83-b242-6320999a4623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.000488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-89981fbf-795f-4507-89e1-92d84bf17ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95436b40c91a4c75bbefdc3acf79cee3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.008260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 981/1967] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:11 2022] DELETE /identity/v3/users/95436b40c91a4c75bbefdc3acf79cee3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:12.012402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-30db22aa-3256-4f83-b242-6320999a4623 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:12.012851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19a8ed-489e-44e6-b6fc-9ab96f540b4f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.013269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19a8ed-489e-44e6-b6fc-9ab96f540b4f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.014277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19a8ed-489e-44e6-b6fc-9ab96f540b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.014636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-30db22aa-3256-4f83-b242-6320999a4623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:12.036787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8b19a8ed-489e-44e6-b6fc-9ab96f540b4f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:12.038143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8b19a8ed-489e-44e6-b6fc-9ab96f540b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:12.079711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 987/1968] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:12.091333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db22aa-3256-4f83-b242-6320999a4623 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.093804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-30db22aa-3256-4f83-b242-6320999a4623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:12.106789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 982/1969] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:12.116133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19a8ed-489e-44e6-b6fc-9ab96f540b4f None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.117529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8b19a8ed-489e-44e6-b6fc-9ab96f540b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:12.145335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:12.159450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db22aa-3256-4f83-b242-6320999a4623 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:12.164412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7838d-3c97-4002-bbea-46b1f088fe2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:12.165054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7838d-3c97-4002-bbea-46b1f088fe2d service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.165334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7838d-3c97-4002-bbea-46b1f088fe2d service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.165609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7838d-3c97-4002-bbea-46b1f088fe2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.174899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7838d-3c97-4002-bbea-46b1f088fe2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:12.175359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19a8ed-489e-44e6-b6fc-9ab96f540b4f None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:12.176327 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7838d-3c97-4002-bbea-46b1f088fe2d service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:12.179121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fa25f-f586-40df-b879-8ae5e2d4c237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:12.179758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fa25f-f586-40df-b879-8ae5e2d4c237 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.180039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fa25f-f586-40df-b879-8ae5e2d4c237 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.180311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fa25f-f586-40df-b879-8ae5e2d4c237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.186628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 988/1970] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:51:12.194633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fa25f-f586-40df-b879-8ae5e2d4c237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:12.196195 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fa25f-f586-40df-b879-8ae5e2d4c237 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:12.207919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 983/1971] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:12.723528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7838d-3c97-4002-bbea-46b1f088fe2d service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.725897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-33c7838d-3c97-4002-bbea-46b1f088fe2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:12.750286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7838d-3c97-4002-bbea-46b1f088fe2d service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:12.755898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:12.756935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.757611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.757953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] PATH_INFO: `/v3/projects/01d9d47d55114ccfb895c184b0f2d0b2` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.759150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d9d47d55114ccfb895c184b0f2d0b2)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:12.762600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:12.775774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fa25f-f586-40df-b879-8ae5e2d4c237 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.777962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-171fa25f-f586-40df-b879-8ae5e2d4c237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:12.804699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fa25f-f586-40df-b879-8ae5e2d4c237 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:12.810198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:12.811951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.812238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.812514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] PATH_INFO: `/v3/projects/4142ab366c2c48b498bd6481cc00f3d2` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.814042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4142ab366c2c48b498bd6481cc00f3d2)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:12.816253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:12.835092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d9d47d55114ccfb895c184b0f2d0b2', 'request_id': 'req-cc1ec171-3fff-474f-9c12-750233c5c66a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.845822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d9d47d55114ccfb895c184b0f2d0b2', 'request_id': 'req-cc1ec171-3fff-474f-9c12-750233c5c66a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.860752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d9d47d55114ccfb895c184b0f2d0b2', 'request_id': 'req-cc1ec171-3fff-474f-9c12-750233c5c66a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.877921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] The token cache is being invalidate because project 01d9d47d55114ccfb895c184b0f2d0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:12.878212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.878911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.879562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:12.880706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 989/1972] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:12 2022] DELETE /identity/v3/projects/01d9d47d55114ccfb895c184b0f2d0b2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:12.885219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4142ab366c2c48b498bd6481cc00f3d2', 'request_id': 'req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.886952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.889297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:12.916156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4142ab366c2c48b498bd6481cc00f3d2', 'request_id': 'req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.928331 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4142ab366c2c48b498bd6481cc00f3d2', 'request_id': 'req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.960022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] The token cache is being invalidate because project 4142ab366c2c48b498bd6481cc00f3d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:12.960245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.964160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2f2c2e07-7717-46a8-b36f-0f9813ec36d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:12.970368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 984/1973] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:12 2022] DELETE /identity/v3/projects/4142ab366c2c48b498bd6481cc00f3d2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:51:12.972215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917fec6-35ef-4b8a-b53b-ce9d2de81cd8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.974715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917fec6-35ef-4b8a-b53b-ce9d2de81cd8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.974884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917fec6-35ef-4b8a-b53b-ce9d2de81cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.033515 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-4917fec6-35ef-4b8a-b53b-ce9d2de81cd8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:13.034869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4917fec6-35ef-4b8a-b53b-ce9d2de81cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:13.043879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ec171-3fff-474f-9c12-750233c5c66a admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:13.186097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 985/1974] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:13.191170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed185c1e-a8dc-4109-83a8-9364e9b88bfc None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.192455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed185c1e-a8dc-4109-83a8-9364e9b88bfc None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.192455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed185c1e-a8dc-4109-83a8-9364e9b88bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.202163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:13.204133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.204133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.204363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] PATH_INFO: `/v3/users/e66ceee3e15e4eaea315c31d081100a4` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.206069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66ceee3e15e4eaea315c31d081100a4)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:13.208422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:13.241566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:13.268254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ed185c1e-a8dc-4109-83a8-9364e9b88bfc None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:13.269584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ed185c1e-a8dc-4109-83a8-9364e9b88bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:13.289514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66ceee3e15e4eaea315c31d081100a4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:13.290290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66ceee3e15e4eaea315c31d081100a4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:13.291293 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66ceee3e15e4eaea315c31d081100a4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:13.292661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 986/1975] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:13.297409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed185c1e-a8dc-4109-83a8-9364e9b88bfc None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:13.311523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed185c1e-a8dc-4109-83a8-9364e9b88bfc None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:13.311943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66ceee3e15e4eaea315c31d081100a4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:13.319795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fe10-213d-4f5b-857b-13459d7dbd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:13.319928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66ceee3e15e4eaea315c31d081100a4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:13.320746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fe10-213d-4f5b-857b-13459d7dbd60 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.321244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fe10-213d-4f5b-857b-13459d7dbd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.321747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fe10-213d-4f5b-857b-13459d7dbd60 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.322976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555fe10-213d-4f5b-857b-13459d7dbd60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:13.323442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555fe10-213d-4f5b-857b-13459d7dbd60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:13.325525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555fe10-213d-4f5b-857b-13459d7dbd60 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:13.337389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 990/1976] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:12 2022] DELETE /identity/v3/users/e66ceee3e15e4eaea315c31d081100a4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:13.345772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 987/1977] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:13.351842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:13.353713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:13.432278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58404c14-6899-4558-b7ea-768688694f8e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:13.437817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a66643-334b-4990-a35c-f5c38ffdee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:13.438573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a66643-334b-4990-a35c-f5c38ffdee39 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.438888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a66643-334b-4990-a35c-f5c38ffdee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.439133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a66643-334b-4990-a35c-f5c38ffdee39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.439829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a66643-334b-4990-a35c-f5c38ffdee39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:13.441727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a66643-334b-4990-a35c-f5c38ffdee39 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:13.478554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 991/1978] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:13 2022] POST /identity/v3/projects => generated 361 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:13.485544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fe10-213d-4f5b-857b-13459d7dbd60 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:13.497651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fe10-213d-4f5b-857b-13459d7dbd60 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:13.593620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc335b20-fe62-4804-88b2-0e6ff0aabddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:13.594401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc335b20-fe62-4804-88b2-0e6ff0aabddc admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.594790 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc335b20-fe62-4804-88b2-0e6ff0aabddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.595266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc335b20-fe62-4804-88b2-0e6ff0aabddc admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.596476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc335b20-fe62-4804-88b2-0e6ff0aabddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:13.598907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc335b20-fe62-4804-88b2-0e6ff0aabddc admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:13.625193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 988/1979] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:13 2022] POST /identity/v3/users => generated 281 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:13.629431 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a66643-334b-4990-a35c-f5c38ffdee39 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:13.640645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db408de9-8f76-4787-8970-a278c1ac031c None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.640645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db408de9-8f76-4787-8970-a278c1ac031c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.640911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db408de9-8f76-4787-8970-a278c1ac031c None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.642544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 989/1980] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:51:13.643483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a66643-334b-4990-a35c-f5c38ffdee39 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:13.648082 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504a393-c1b0-491a-9c19-fc1d2f2ede57 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.648372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504a393-c1b0-491a-9c19-fc1d2f2ede57 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.648651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504a393-c1b0-491a-9c19-fc1d2f2ede57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.648901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceba7e-f522-4c9e-9a84-b66f8e426091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:13.649576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceba7e-f522-4c9e-9a84-b66f8e426091 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.649860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceba7e-f522-4c9e-9a84-b66f8e426091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.650232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faceba7e-f522-4c9e-9a84-b66f8e426091 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.651015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faceba7e-f522-4c9e-9a84-b66f8e426091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:13.652901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faceba7e-f522-4c9e-9a84-b66f8e426091 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:13.675234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 992/1981] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:51:13.680188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceba7e-f522-4c9e-9a84-b66f8e426091 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:13.690696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8504a393-c1b0-491a-9c19-fc1d2f2ede57 None None] MFA Rules not processed for user `64ce422f60d64b368df8be61e1065282`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:13.691939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8504a393-c1b0-491a-9c19-fc1d2f2ede57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:13.713417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faceba7e-f522-4c9e-9a84-b66f8e426091 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:13.725879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913ef2-14e5-4e5f-be0d-8b6a2ffcce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:13.726645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913ef2-14e5-4e5f-be0d-8b6a2ffcce9e admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.726871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913ef2-14e5-4e5f-be0d-8b6a2ffcce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.727154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913ef2-14e5-4e5f-be0d-8b6a2ffcce9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.761718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913ef2-14e5-4e5f-be0d-8b6a2ffcce9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:13.771752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913ef2-14e5-4e5f-be0d-8b6a2ffcce9e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:13.795274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 993/1982] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:13.795274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913ef2-14e5-4e5f-be0d-8b6a2ffcce9e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:13.806662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-37913ef2-14e5-4e5f-be0d-8b6a2ffcce9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:13.825516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:13.831413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913ef2-14e5-4e5f-be0d-8b6a2ffcce9e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:13.839924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:13.841028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:13.841287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:13.842483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] PATH_INFO: `/v3/projects/568eed56efcd4bad923f38dd1425b905` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:13.844026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=568eed56efcd4bad923f38dd1425b905)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:13.847997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:13.894477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 990/1983] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:51:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:13.895462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504a393-c1b0-491a-9c19-fc1d2f2ede57 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:13.918100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504a393-c1b0-491a-9c19-fc1d2f2ede57 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:13.943557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568eed56efcd4bad923f38dd1425b905', 'request_id': 'req-d228133f-b8b7-4a61-98a1-258618252836'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:13.946708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:13.961197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568eed56efcd4bad923f38dd1425b905', 'request_id': 'req-d228133f-b8b7-4a61-98a1-258618252836'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:13.977281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568eed56efcd4bad923f38dd1425b905', 'request_id': 'req-d228133f-b8b7-4a61-98a1-258618252836'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:13.991773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] The token cache is being invalidate because project 568eed56efcd4bad923f38dd1425b905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:13.992362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:13.999509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:14.002505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 994/1984] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:13 2022] DELETE /identity/v3/projects/568eed56efcd4bad923f38dd1425b905 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:14.003428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.005703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:14.010918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3109066-92ad-4a03-83a1-c172b8fa234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.012559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3109066-92ad-4a03-83a1-c172b8fa234d admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.012748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3109066-92ad-4a03-83a1-c172b8fa234d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.012958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3109066-92ad-4a03-83a1-c172b8fa234d admin admin] PATH_INFO: `/v3/projects/abc9aaa13e6048da86ae8b68309396cc/users/a9428fbe45914732b687545b9eab2406/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.036900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3109066-92ad-4a03-83a1-c172b8fa234d admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc9aaa13e6048da86ae8b68309396cc, user_id=a9428fbe45914732b687545b9eab2406, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.039630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3109066-92ad-4a03-83a1-c172b8fa234d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.068099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 991/1985] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:13 2022] PUT /identity/v3/projects/abc9aaa13e6048da86ae8b68309396cc/users/a9428fbe45914732b687545b9eab2406/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:14.068099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be9772-5e24-42b9-aa45-c69ce54e5181 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.068099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be9772-5e24-42b9-aa45-c69ce54e5181 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.068099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be9772-5e24-42b9-aa45-c69ce54e5181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.089033 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-56be9772-5e24-42b9-aa45-c69ce54e5181 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:14.090485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-56be9772-5e24-42b9-aa45-c69ce54e5181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:14.099166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228133f-b8b7-4a61-98a1-258618252836 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.182227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb34dd-228e-4816-bc8a-08727de0304d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.183171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb34dd-228e-4816-bc8a-08727de0304d service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.183585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb34dd-228e-4816-bc8a-08727de0304d service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.184007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb34dd-228e-4816-bc8a-08727de0304d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.185583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 992/1986] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:14.186772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9dcb34dd-228e-4816-bc8a-08727de0304d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:14.187399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587a206-671c-4f5e-b154-750191d42867 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.187967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587a206-671c-4f5e-b154-750191d42867 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.188392 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587a206-671c-4f5e-b154-750191d42867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.219583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb34dd-228e-4816-bc8a-08727de0304d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.221191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb34dd-228e-4816-bc8a-08727de0304d service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.228455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0587a206-671c-4f5e-b154-750191d42867 None None] MFA Rules not processed for user `a9428fbe45914732b687545b9eab2406`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:14.229676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0587a206-671c-4f5e-b154-750191d42867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:14.243180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 995/1987] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:14.244741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296497b5-3132-4667-b8c0-26b07525a3f3 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.245036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296497b5-3132-4667-b8c0-26b07525a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.245321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296497b5-3132-4667-b8c0-26b07525a3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.267020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-296497b5-3132-4667-b8c0-26b07525a3f3 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:14.268253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-296497b5-3132-4667-b8c0-26b07525a3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:14.278369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 996/1988] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:14.283192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296497b5-3132-4667-b8c0-26b07525a3f3 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.312350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296497b5-3132-4667-b8c0-26b07525a3f3 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.319116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:14.321285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665c83-b823-40bd-a51d-904e5259cfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.322311 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665c83-b823-40bd-a51d-904e5259cfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.323170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665c83-b823-40bd-a51d-904e5259cfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.323534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31665c83-b823-40bd-a51d-904e5259cfc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.324328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665c83-b823-40bd-a51d-904e5259cfc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:14.324708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665c83-b823-40bd-a51d-904e5259cfc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.327300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31665c83-b823-40bd-a51d-904e5259cfc1 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.346536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 997/1989] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:14.350726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665c83-b823-40bd-a51d-904e5259cfc1 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.364604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31665c83-b823-40bd-a51d-904e5259cfc1 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.375662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa21847-0d86-4541-b162-a22d34cef894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.376823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 993/1990] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:14.378265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa21847-0d86-4541-b162-a22d34cef894 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.378753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa21847-0d86-4541-b162-a22d34cef894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.379414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa21847-0d86-4541-b162-a22d34cef894 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.380303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa21847-0d86-4541-b162-a22d34cef894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.385268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa21847-0d86-4541-b162-a22d34cef894 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.451338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587a206-671c-4f5e-b154-750191d42867 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.452874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 998/1991] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:14 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:14.456871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa21847-0d86-4541-b162-a22d34cef894 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.457620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0587a206-671c-4f5e-b154-750191d42867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:14.534807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:14.565135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587a206-671c-4f5e-b154-750191d42867 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.582234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa21847-0d86-4541-b162-a22d34cef894 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.587114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95989a23-6df6-4c06-a79a-6861145138e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.587796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95989a23-6df6-4c06-a79a-6861145138e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.588084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95989a23-6df6-4c06-a79a-6861145138e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.588454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95989a23-6df6-4c06-a79a-6861145138e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.596038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95989a23-6df6-4c06-a79a-6861145138e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.612866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95989a23-6df6-4c06-a79a-6861145138e0 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.642265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 999/1992] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:14 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:14.643634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95989a23-6df6-4c06-a79a-6861145138e0 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.645299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cbc29-dd48-4e40-89b8-a6d05afe2013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.646258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cbc29-dd48-4e40-89b8-a6d05afe2013 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.646582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cbc29-dd48-4e40-89b8-a6d05afe2013 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.647122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cbc29-dd48-4e40-89b8-a6d05afe2013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.658263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95989a23-6df6-4c06-a79a-6861145138e0 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.666756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad32133-b8cd-40a8-9f5f-a5a13c4aacc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.667639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad32133-b8cd-40a8-9f5f-a5a13c4aacc9 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.668230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad32133-b8cd-40a8-9f5f-a5a13c4aacc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.668664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad32133-b8cd-40a8-9f5f-a5a13c4aacc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.670219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad32133-b8cd-40a8-9f5f-a5a13c4aacc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.672531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad32133-b8cd-40a8-9f5f-a5a13c4aacc9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.686164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1000/1993] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:14.690778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad32133-b8cd-40a8-9f5f-a5a13c4aacc9 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.703173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad32133-b8cd-40a8-9f5f-a5a13c4aacc9 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.710119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054309-97dd-4fff-a8cb-4b06d8aa93c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.711047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054309-97dd-4fff-a8cb-4b06d8aa93c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.711407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054309-97dd-4fff-a8cb-4b06d8aa93c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.711769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4054309-97dd-4fff-a8cb-4b06d8aa93c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.712576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4054309-97dd-4fff-a8cb-4b06d8aa93c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.714519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4054309-97dd-4fff-a8cb-4b06d8aa93c3 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.730560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cbc29-dd48-4e40-89b8-a6d05afe2013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.732006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1001/1994] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:14.733636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054309-97dd-4fff-a8cb-4b06d8aa93c3 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.734542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cbc29-dd48-4e40-89b8-a6d05afe2013 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.744836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4054309-97dd-4fff-a8cb-4b06d8aa93c3 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.751152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f804f44-6bae-46a6-8bbf-bb6af64a65fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.752103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f804f44-6bae-46a6-8bbf-bb6af64a65fd admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.752403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f804f44-6bae-46a6-8bbf-bb6af64a65fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.752700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f804f44-6bae-46a6-8bbf-bb6af64a65fd admin admin] PATH_INFO: `/v3/projects/879ff4a41ee94a169895df092d7d7716/users/e2008f4138e9462ca4973eea2b9d82b9/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.761164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 994/1995] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:51:14.769353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f804f44-6bae-46a6-8bbf-bb6af64a65fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=879ff4a41ee94a169895df092d7d7716, user_id=e2008f4138e9462ca4973eea2b9d82b9, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.775102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f804f44-6bae-46a6-8bbf-bb6af64a65fd admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.778588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cbc29-dd48-4e40-89b8-a6d05afe2013 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.780431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-734cbc29-dd48-4e40-89b8-a6d05afe2013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:14.792788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1002/1996] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:14 2022] PUT /identity/v3/projects/879ff4a41ee94a169895df092d7d7716/users/e2008f4138e9462ca4973eea2b9d82b9/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:14.798949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cbc29-dd48-4e40-89b8-a6d05afe2013 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.809568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30028-17fc-4599-bb59-7442441b7b6c None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.809568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30028-17fc-4599-bb59-7442441b7b6c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.809568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30028-17fc-4599-bb59-7442441b7b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.844209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-49c30028-17fc-4599-bb59-7442441b7b6c None None] MFA Rules not processed for user `e2008f4138e9462ca4973eea2b9d82b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:14.845448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-49c30028-17fc-4599-bb59-7442441b7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:14.878143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.879198 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.879584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.879980 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] PATH_INFO: `/v3/users/a9428fbe45914732b687545b9eab2406` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.881736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9428fbe45914732b687545b9eab2406)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.884554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.887346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:14.933108 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1003/1997] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:14.938356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c30028-17fc-4599-bb59-7442441b7b6c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.940142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-49c30028-17fc-4599-bb59-7442441b7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:14.945681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9428fbe45914732b687545b9eab2406'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:14.947252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9428fbe45914732b687545b9eab2406'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:14.957101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c30028-17fc-4599-bb59-7442441b7b6c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:14.961664 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9428fbe45914732b687545b9eab2406'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:14.962068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:14.963070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.963456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.963827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] PATH_INFO: `/v3/users/e5220d40c6ed4245bcbcf87f67cdd150` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.965139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5220d40c6ed4245bcbcf87f67cdd150)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:14.967871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:14.969596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9428fbe45914732b687545b9eab2406'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:14.979934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9428fbe45914732b687545b9eab2406'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:14.990477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 995/1998] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:14 2022] DELETE /identity/v3/users/a9428fbe45914732b687545b9eab2406 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:14.991348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:14.992700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:15.026570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5220d40c6ed4245bcbcf87f67cdd150'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.027542 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5220d40c6ed4245bcbcf87f67cdd150'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.028215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5220d40c6ed4245bcbcf87f67cdd150'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.039247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:15.046291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5220d40c6ed4245bcbcf87f67cdd150'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.062281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-397fea41-aa30-448a-98e2-136693a15481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5220d40c6ed4245bcbcf87f67cdd150'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.082733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1004/1999] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:14 2022] DELETE /identity/v3/users/e5220d40c6ed4245bcbcf87f67cdd150 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:15.084560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44650c-eb0c-4768-af3a-805306d1ef88 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.095909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44650c-eb0c-4768-af3a-805306d1ef88 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.098297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44650c-eb0c-4768-af3a-805306d1ef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.104911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6247dd-7645-40b6-a6cb-e650e60f97a6 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.148769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-af44650c-eb0c-4768-af3a-805306d1ef88 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:15.150032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-af44650c-eb0c-4768-af3a-805306d1ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:15.209849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cd84f-5662-4ae1-aee7-ba29465b7798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.210763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cd84f-5662-4ae1-aee7-ba29465b7798 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.211208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cd84f-5662-4ae1-aee7-ba29465b7798 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.211586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cd84f-5662-4ae1-aee7-ba29465b7798 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.212770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cd84f-5662-4ae1-aee7-ba29465b7798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.215210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cd84f-5662-4ae1-aee7-ba29465b7798 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.246656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1005/2000] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:15.253675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 996/2001] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:14 2022] POST /identity/v3/projects => generated 399 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:15.257806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44650c-eb0c-4768-af3a-805306d1ef88 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.259420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-af44650c-eb0c-4768-af3a-805306d1ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:15.259863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cd84f-5662-4ae1-aee7-ba29465b7798 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.264834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-078cd84f-5662-4ae1-aee7-ba29465b7798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:15.275383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44650c-eb0c-4768-af3a-805306d1ef88 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.292289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:15.357431 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71eb9-3395-4dc5-a036-34f0be331eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.358254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71eb9-3395-4dc5-a036-34f0be331eae admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.358685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71eb9-3395-4dc5-a036-34f0be331eae admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.358966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad71eb9-3395-4dc5-a036-34f0be331eae admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.359887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad71eb9-3395-4dc5-a036-34f0be331eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.362368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad71eb9-3395-4dc5-a036-34f0be331eae admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.363847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cd84f-5662-4ae1-aee7-ba29465b7798 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.368273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ec645-01e4-47af-b011-62ee86531270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.370658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ec645-01e4-47af-b011-62ee86531270 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.371734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ec645-01e4-47af-b011-62ee86531270 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.371734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ec645-01e4-47af-b011-62ee86531270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.389025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ec645-01e4-47af-b011-62ee86531270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.390848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ec645-01e4-47af-b011-62ee86531270 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.396180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1006/2002] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:15 2022] POST /identity/v3/users => generated 306 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:15.399931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71eb9-3395-4dc5-a036-34f0be331eae admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.401865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 997/2003] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:15.410745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad71eb9-3395-4dc5-a036-34f0be331eae admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.430253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f3c48-d883-4935-a37d-c7af6a9dd575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.431041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f3c48-d883-4935-a37d-c7af6a9dd575 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.431323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f3c48-d883-4935-a37d-c7af6a9dd575 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.431605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f3c48-d883-4935-a37d-c7af6a9dd575 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.432342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f3c48-d883-4935-a37d-c7af6a9dd575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.433970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f3c48-d883-4935-a37d-c7af6a9dd575 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.470494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1007/2004] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:15.470700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ec645-01e4-47af-b011-62ee86531270 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.486005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ec645-01e4-47af-b011-62ee86531270 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.499493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67325c-c8ae-4dc2-83a2-91c022c848c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.501843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67325c-c8ae-4dc2-83a2-91c022c848c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.504233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67325c-c8ae-4dc2-83a2-91c022c848c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.507629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67325c-c8ae-4dc2-83a2-91c022c848c3 admin admin] PATH_INFO: `/v3/projects/e692de7733b74f1b8e113730d7e40ad9/users/ce774dcd5e464ab58faece95feb2dafb/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.540647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67325c-c8ae-4dc2-83a2-91c022c848c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e692de7733b74f1b8e113730d7e40ad9, user_id=ce774dcd5e464ab58faece95feb2dafb, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.543509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67325c-c8ae-4dc2-83a2-91c022c848c3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.558644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 998/2005] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:15 2022] PUT /identity/v3/projects/e692de7733b74f1b8e113730d7e40ad9/users/ce774dcd5e464ab58faece95feb2dafb/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:15.563334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f3c48-d883-4935-a37d-c7af6a9dd575 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.574210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f3c48-d883-4935-a37d-c7af6a9dd575 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.601862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67325c-c8ae-4dc2-83a2-91c022c848c3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.603736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0b67325c-c8ae-4dc2-83a2-91c022c848c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:15.698932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59de44-3381-4b42-8ffa-dc2f5057d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.699904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59de44-3381-4b42-8ffa-dc2f5057d44d admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.700207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59de44-3381-4b42-8ffa-dc2f5057d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.700618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59de44-3381-4b42-8ffa-dc2f5057d44d admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.701929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59de44-3381-4b42-8ffa-dc2f5057d44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.703975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59de44-3381-4b42-8ffa-dc2f5057d44d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.712784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:15.721236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1008/2006] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:51:15.722510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59de44-3381-4b42-8ffa-dc2f5057d44d admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.745020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59de44-3381-4b42-8ffa-dc2f5057d44d admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.754384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67325c-c8ae-4dc2-83a2-91c022c848c3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.757828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99f6b4-593c-434a-9b6e-b6ddb313a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.758926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99f6b4-593c-434a-9b6e-b6ddb313a28b admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.759213 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99f6b4-593c-434a-9b6e-b6ddb313a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.759497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99f6b4-593c-434a-9b6e-b6ddb313a28b admin admin] PATH_INFO: `/v3/projects/e692de7733b74f1b8e113730d7e40ad9/users/ce774dcd5e464ab58faece95feb2dafb/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.762293 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99f6b4-593c-434a-9b6e-b6ddb313a28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e692de7733b74f1b8e113730d7e40ad9, user_id=ce774dcd5e464ab58faece95feb2dafb, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.766597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99f6b4-593c-434a-9b6e-b6ddb313a28b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.770576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.771452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.771741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.772021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] PATH_INFO: `/v3/projects/43487b90fb914664bc34189acb929291` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.773909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43487b90fb914664bc34189acb929291)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.775989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.795952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1009/2007] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:15 2022] PUT /identity/v3/projects/e692de7733b74f1b8e113730d7e40ad9/users/ce774dcd5e464ab58faece95feb2dafb/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:15.806236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77784-21f0-4676-b3ca-73d1f2f6a9d5 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.806588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77784-21f0-4676-b3ca-73d1f2f6a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.806871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77784-21f0-4676-b3ca-73d1f2f6a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.872454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-b5b77784-21f0-4676-b3ca-73d1f2f6a9d5 None None] MFA Rules not processed for user `ce774dcd5e464ab58faece95feb2dafb`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:15.876041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b5b77784-21f0-4676-b3ca-73d1f2f6a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:15.885294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43487b90fb914664bc34189acb929291', 'request_id': 'req-100d3872-6705-4c08-89e5-6b44abc501f8'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.899211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43487b90fb914664bc34189acb929291', 'request_id': 'req-100d3872-6705-4c08-89e5-6b44abc501f8'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.907656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43487b90fb914664bc34189acb929291', 'request_id': 'req-100d3872-6705-4c08-89e5-6b44abc501f8'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.926099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] The token cache is being invalidate because project 43487b90fb914664bc34189acb929291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:15.926548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.927697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:15.933710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 999/2008] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:15 2022] DELETE /identity/v3/projects/43487b90fb914664bc34189acb929291 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:15.934933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.938738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:15.983275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:15.986358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1010/2009] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:15.987850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77784-21f0-4676-b3ca-73d1f2f6a9d5 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.989962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b5b77784-21f0-4676-b3ca-73d1f2f6a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.050637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d3872-6705-4c08-89e5-6b44abc501f8 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.055521 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.056454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.056797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.057135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] PATH_INFO: `/v3/projects/abc9aaa13e6048da86ae8b68309396cc` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.058338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc9aaa13e6048da86ae8b68309396cc)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.060906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.087984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77784-21f0-4676-b3ca-73d1f2f6a9d5 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.093396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.094462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.094829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.095084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] PATH_INFO: `/v3/users/8110ed4429bd477b82cb385a590b8fdf` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.096391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8110ed4429bd477b82cb385a590b8fdf)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.098382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.114495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc9aaa13e6048da86ae8b68309396cc', 'request_id': 'req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.122151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc9aaa13e6048da86ae8b68309396cc', 'request_id': 'req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.130200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc9aaa13e6048da86ae8b68309396cc', 'request_id': 'req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.141818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] The token cache is being invalidate because project abc9aaa13e6048da86ae8b68309396cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:16.142112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.142810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.144365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1000/2010] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:15 2022] DELETE /identity/v3/projects/abc9aaa13e6048da86ae8b68309396cc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:16.147268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8110ed4429bd477b82cb385a590b8fdf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.148098 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8110ed4429bd477b82cb385a590b8fdf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.148346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.148780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8110ed4429bd477b82cb385a590b8fdf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.149670 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.161697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8110ed4429bd477b82cb385a590b8fdf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.163408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:16.171116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6588e16d-ecb5-4f96-9f2a-4795e08007f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8110ed4429bd477b82cb385a590b8fdf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.188065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1011/2011] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:15 2022] DELETE /identity/v3/users/8110ed4429bd477b82cb385a590b8fdf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:16.188666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297c5f7-a229-476d-96e8-6d394fb35da6 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.189017 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297c5f7-a229-476d-96e8-6d394fb35da6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.189239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297c5f7-a229-476d-96e8-6d394fb35da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.219142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-4297c5f7-a229-476d-96e8-6d394fb35da6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:16.220865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4297c5f7-a229-476d-96e8-6d394fb35da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.228833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef8cfa-f3a3-44d5-a442-2acde201fa5f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.287347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.288002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.288282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.288555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.290439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.299822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1012/2012] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:16.307719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bb02e-c37f-448a-a52a-5d0d17428b9c None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.308247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bb02e-c37f-448a-a52a-5d0d17428b9c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.308675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bb02e-c37f-448a-a52a-5d0d17428b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.325999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:16.331467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-7b3bb02e-c37f-448a-a52a-5d0d17428b9c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:16.333260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7b3bb02e-c37f-448a-a52a-5d0d17428b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.344976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1013/2013] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:16.349349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bb02e-c37f-448a-a52a-5d0d17428b9c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.360493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bb02e-c37f-448a-a52a-5d0d17428b9c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.365747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1ac2a-78e7-48ca-977e-47cee70de63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.366577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1ac2a-78e7-48ca-977e-47cee70de63c admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.366867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1ac2a-78e7-48ca-977e-47cee70de63c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.367151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1ac2a-78e7-48ca-977e-47cee70de63c admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.367909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1ac2a-78e7-48ca-977e-47cee70de63c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:16.368221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1ac2a-78e7-48ca-977e-47cee70de63c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.369846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1ac2a-78e7-48ca-977e-47cee70de63c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.385348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1014/2014] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:16.390334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1ac2a-78e7-48ca-977e-47cee70de63c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.396640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.398970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.403633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1ac2a-78e7-48ca-977e-47cee70de63c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.410044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e449ef-0c24-40a0-8df9-effbb50e5308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.410766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e449ef-0c24-40a0-8df9-effbb50e5308 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.411051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e449ef-0c24-40a0-8df9-effbb50e5308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.411471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e449ef-0c24-40a0-8df9-effbb50e5308 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.412219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e449ef-0c24-40a0-8df9-effbb50e5308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.413524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1001/2015] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:16.414157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e449ef-0c24-40a0-8df9-effbb50e5308 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.427385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.430940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.449367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad049b-d6b4-4f45-889e-73a152f005a6 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.456820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.457783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.458070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.458454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] PATH_INFO: `/v3/projects/7bd7cce8a53147baa62b8e9a976ab5cf` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.459723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd7cce8a53147baa62b8e9a976ab5cf)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.461792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.463413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1015/2016] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:16 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:16.469280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e449ef-0c24-40a0-8df9-effbb50e5308 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.528493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd7cce8a53147baa62b8e9a976ab5cf', 'request_id': 'req-ab80d59d-c886-492f-8ccf-4e66b6e69f95'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.553927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd7cce8a53147baa62b8e9a976ab5cf', 'request_id': 'req-ab80d59d-c886-492f-8ccf-4e66b6e69f95'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.566762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd7cce8a53147baa62b8e9a976ab5cf', 'request_id': 'req-ab80d59d-c886-492f-8ccf-4e66b6e69f95'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.584716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e449ef-0c24-40a0-8df9-effbb50e5308 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.588109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] The token cache is being invalidate because project 7bd7cce8a53147baa62b8e9a976ab5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:16.588481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.589245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:16.591034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1002/2017] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:16 2022] DELETE /identity/v3/projects/7bd7cce8a53147baa62b8e9a976ab5cf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:16.592230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.595652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.685861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:16.689258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80d59d-c886-492f-8ccf-4e66b6e69f95 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.694944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e99977-7daa-4df8-9f2d-95c3d71048c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.696026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e99977-7daa-4df8-9f2d-95c3d71048c0 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.696026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e99977-7daa-4df8-9f2d-95c3d71048c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.696218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e99977-7daa-4df8-9f2d-95c3d71048c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.699839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-68e99977-7daa-4df8-9f2d-95c3d71048c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.713853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95af37-9525-4a09-ba8c-6d2126cde444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.714979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95af37-9525-4a09-ba8c-6d2126cde444 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.715276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95af37-9525-4a09-ba8c-6d2126cde444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.715634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95af37-9525-4a09-ba8c-6d2126cde444 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.716254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95af37-9525-4a09-ba8c-6d2126cde444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.718952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95af37-9525-4a09-ba8c-6d2126cde444 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.753648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1016/2018] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:16 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:16.756072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e44d9c-a736-4189-879b-b5305c9842a2 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.756410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e44d9c-a736-4189-879b-b5305c9842a2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.756713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e44d9c-a736-4189-879b-b5305c9842a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.777025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c3e44d9c-a736-4189-879b-b5305c9842a2 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:16.778247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c3e44d9c-a736-4189-879b-b5305c9842a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.783274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:16.786113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e99977-7daa-4df8-9f2d-95c3d71048c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.796618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1017/2019] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:16.796618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e44d9c-a736-4189-879b-b5305c9842a2 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.796936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e99977-7daa-4df8-9f2d-95c3d71048c0 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.797044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c3e44d9c-a736-4189-879b-b5305c9842a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.800768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1003/2020] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:16.802285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f2212-e429-48eb-9264-aad77c2e6f39 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.802711 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f2212-e429-48eb-9264-aad77c2e6f39 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.803000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f2212-e429-48eb-9264-aad77c2e6f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.805364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e44d9c-a736-4189-879b-b5305c9842a2 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.811156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059e57-ef8b-4b3d-96f0-8870b1921f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.811874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059e57-ef8b-4b3d-96f0-8870b1921f32 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.812459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059e57-ef8b-4b3d-96f0-8870b1921f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.812705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059e57-ef8b-4b3d-96f0-8870b1921f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.813510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c059e57-ef8b-4b3d-96f0-8870b1921f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.815517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c059e57-ef8b-4b3d-96f0-8870b1921f32 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.823871 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7f8f2212-e429-48eb-9264-aad77c2e6f39 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:16.825094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7f8f2212-e429-48eb-9264-aad77c2e6f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:16.830886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1018/2021] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:16.837883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1004/2022] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:16.838063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059e57-ef8b-4b3d-96f0-8870b1921f32 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.839245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f2212-e429-48eb-9264-aad77c2e6f39 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.846745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059e57-ef8b-4b3d-96f0-8870b1921f32 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.849431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f2212-e429-48eb-9264-aad77c2e6f39 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.851760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f0645-ccff-4221-a5ab-2d8bd483649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.852420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f0645-ccff-4221-a5ab-2d8bd483649b admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.852700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f0645-ccff-4221-a5ab-2d8bd483649b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.852977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f0645-ccff-4221-a5ab-2d8bd483649b admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.853688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f0645-ccff-4221-a5ab-2d8bd483649b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.855482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f0645-ccff-4221-a5ab-2d8bd483649b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.855995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e29d-967a-4e50-be96-1fb6329d5fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.856909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e29d-967a-4e50-be96-1fb6329d5fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.857885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e29d-967a-4e50-be96-1fb6329d5fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.858295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541e29d-967a-4e50-be96-1fb6329d5fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.859186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541e29d-967a-4e50-be96-1fb6329d5fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:16.859831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541e29d-967a-4e50-be96-1fb6329d5fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.861529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541e29d-967a-4e50-be96-1fb6329d5fe7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.867579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1019/2023] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:16.871875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f0645-ccff-4221-a5ab-2d8bd483649b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.884232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1005/2024] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:16.884376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f0645-ccff-4221-a5ab-2d8bd483649b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.889968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e29d-967a-4e50-be96-1fb6329d5fe7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.899432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629bc5a-f817-4b8f-bc3d-813cad793411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.899432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629bc5a-f817-4b8f-bc3d-813cad793411 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.899432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629bc5a-f817-4b8f-bc3d-813cad793411 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.899432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629bc5a-f817-4b8f-bc3d-813cad793411 admin admin] PATH_INFO: `/v3/projects/c295c57d982541c0b9d8d7cc09259c40/users/34c3dda77fb3485ea17b6c3bf8a43f99/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.909078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541e29d-967a-4e50-be96-1fb6329d5fe7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:16.913842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e229fd-1323-44c3-992c-5d680c4e5048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:16.914541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e229fd-1323-44c3-992c-5d680c4e5048 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.914832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e229fd-1323-44c3-992c-5d680c4e5048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.915124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e229fd-1323-44c3-992c-5d680c4e5048 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.915819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e229fd-1323-44c3-992c-5d680c4e5048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.917754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e229fd-1323-44c3-992c-5d680c4e5048 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.922247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629bc5a-f817-4b8f-bc3d-813cad793411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c295c57d982541c0b9d8d7cc09259c40, user_id=34c3dda77fb3485ea17b6c3bf8a43f99, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:16.926915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629bc5a-f817-4b8f-bc3d-813cad793411 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:16.948846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1020/2025] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:16 2022] PUT /identity/v3/projects/c295c57d982541c0b9d8d7cc09259c40/users/34c3dda77fb3485ea17b6c3bf8a43f99/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:16.960825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313249d-74e3-40ea-ab7f-f330c31dc632 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:16.961119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313249d-74e3-40ea-ab7f-f330c31dc632 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:16.961427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313249d-74e3-40ea-ab7f-f330c31dc632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:16.964067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1006/2026] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:16 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:16.968558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e229fd-1323-44c3-992c-5d680c4e5048 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:16.998944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2313249d-74e3-40ea-ab7f-f330c31dc632 None None] MFA Rules not processed for user `34c3dda77fb3485ea17b6c3bf8a43f99`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:17.000546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2313249d-74e3-40ea-ab7f-f330c31dc632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:17.089344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e229fd-1323-44c3-992c-5d680c4e5048 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:17.103131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fdd27-c7f1-46b4-bd3c-58def95d5d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:17.103953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fdd27-c7f1-46b4-bd3c-58def95d5d65 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.104270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fdd27-c7f1-46b4-bd3c-58def95d5d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.104538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fdd27-c7f1-46b4-bd3c-58def95d5d65 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:17.105297 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fdd27-c7f1-46b4-bd3c-58def95d5d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:17.110836 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fdd27-c7f1-46b4-bd3c-58def95d5d65 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:17.126389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1021/2027] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:17.145328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313249d-74e3-40ea-ab7f-f330c31dc632 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:17.147012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2313249d-74e3-40ea-ab7f-f330c31dc632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:17.149907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1007/2028] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:16 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:17.155267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fdd27-c7f1-46b4-bd3c-58def95d5d65 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:17.173309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fdd27-c7f1-46b4-bd3c-58def95d5d65 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:17.183575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de4676-9183-4d38-94d2-492990961c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:17.184629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de4676-9183-4d38-94d2-492990961c12 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.185118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de4676-9183-4d38-94d2-492990961c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.186930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de4676-9183-4d38-94d2-492990961c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:17.187995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de4676-9183-4d38-94d2-492990961c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:17.190308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de4676-9183-4d38-94d2-492990961c12 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:17.206450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1008/2029] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:17.210343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de4676-9183-4d38-94d2-492990961c12 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:17.224321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de4676-9183-4d38-94d2-492990961c12 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:17.229404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a770e25-53f3-41ab-8d46-b37c4443e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:17.230557 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a770e25-53f3-41ab-8d46-b37c4443e979 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.230940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a770e25-53f3-41ab-8d46-b37c4443e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.231343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a770e25-53f3-41ab-8d46-b37c4443e979 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:17.232978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a770e25-53f3-41ab-8d46-b37c4443e979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:17.236666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a770e25-53f3-41ab-8d46-b37c4443e979 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:17.251575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1009/2030] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:51:17.255375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a770e25-53f3-41ab-8d46-b37c4443e979 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:17.270588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a770e25-53f3-41ab-8d46-b37c4443e979 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:17.280468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313249d-74e3-40ea-ab7f-f330c31dc632 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:17.285280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4fcf8-41a2-4304-a874-4661861d5ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:17.286474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4fcf8-41a2-4304-a874-4661861d5ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.286865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4fcf8-41a2-4304-a874-4661861d5ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.287237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4fcf8-41a2-4304-a874-4661861d5ab5 admin admin] PATH_INFO: `/v3/projects/ce2943e715cb4192b3f13b81be7e167a/users/99b002e85d464be18f7836c82ece354f/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:17.293058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a4bb0-5d94-4c8d-b6e9-12aedb150ed3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a1696d1cc14ca6ac1cb970598f11fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:17.295227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4bb0-5d94-4c8d-b6e9-12aedb150ed3 service glance] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.295531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4bb0-5d94-4c8d-b6e9-12aedb150ed3 service glance] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.295819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a4bb0-5d94-4c8d-b6e9-12aedb150ed3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:17.316242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a4bb0-5d94-4c8d-b6e9-12aedb150ed3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:17.319689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a4bb0-5d94-4c8d-b6e9-12aedb150ed3 service glance] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:17.348574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4fcf8-41a2-4304-a874-4661861d5ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2943e715cb4192b3f13b81be7e167a, user_id=99b002e85d464be18f7836c82ece354f, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:17.349587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1022/2031] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:17.353668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4fcf8-41a2-4304-a874-4661861d5ab5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:17.398374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1010/2032] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:17 2022] PUT /identity/v3/projects/ce2943e715cb4192b3f13b81be7e167a/users/99b002e85d464be18f7836c82ece354f/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:17.409444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80438d39-cddb-488f-a8ff-3d0fe5859d42 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.409945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80438d39-cddb-488f-a8ff-3d0fe5859d42 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.411030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80438d39-cddb-488f-a8ff-3d0fe5859d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:17.450533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-80438d39-cddb-488f-a8ff-3d0fe5859d42 None None] MFA Rules not processed for user `99b002e85d464be18f7836c82ece354f`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:17.452922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-80438d39-cddb-488f-a8ff-3d0fe5859d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:17.460655 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:17.592116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1023/2033] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:17.862527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4fcf8-41a2-4304-a874-4661861d5ab5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:18.023069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4fcf8-41a2-4304-a874-4661861d5ab5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:18.030156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe3091-62ab-455b-93e5-6e93fe0efa3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:18.031273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3091-62ab-455b-93e5-6e93fe0efa3a service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:18.031862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3091-62ab-455b-93e5-6e93fe0efa3a service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:18.032376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe3091-62ab-455b-93e5-6e93fe0efa3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:18.044100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3091-62ab-455b-93e5-6e93fe0efa3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:18.047589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe3091-62ab-455b-93e5-6e93fe0efa3a service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:18.054443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:18.064446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1011/2034] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:26.676851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80438d39-cddb-488f-a8ff-3d0fe5859d42 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:26.678407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-80438d39-cddb-488f-a8ff-3d0fe5859d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:26.768778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80438d39-cddb-488f-a8ff-3d0fe5859d42 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:26.776090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:26.776090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.776090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.776405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] PATH_INFO: `/v3/users/e2008f4138e9462ca4973eea2b9d82b9` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.777538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2008f4138e9462ca4973eea2b9d82b9)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:26.780393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:26.836208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2008f4138e9462ca4973eea2b9d82b9'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:26.836883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2008f4138e9462ca4973eea2b9d82b9'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:26.837520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2008f4138e9462ca4973eea2b9d82b9'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:26.850464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2008f4138e9462ca4973eea2b9d82b9'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:26.858609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2008f4138e9462ca4973eea2b9d82b9'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:26.871966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1024/2035] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:26 2022] DELETE /identity/v3/users/e2008f4138e9462ca4973eea2b9d82b9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:26.877375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fcb9b-c860-4059-b7a5-1ed677818ee8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.877890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fcb9b-c860-4059-b7a5-1ed677818ee8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.877982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fcb9b-c860-4059-b7a5-1ed677818ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.895285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-089fcb9b-c860-4059-b7a5-1ed677818ee8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:26.896737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-089fcb9b-c860-4059-b7a5-1ed677818ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:26.961331 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1012/2036] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:26.971401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:26.972832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:27.009365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:27.038174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dae559-e1ba-4d34-83e3-efdec0cfd84b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:27.041832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b69b3-32fd-4e5c-b510-cf29ad8c644c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:27.042519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b69b3-32fd-4e5c-b510-cf29ad8c644c service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:27.042804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b69b3-32fd-4e5c-b510-cf29ad8c644c service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:27.043083 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b69b3-32fd-4e5c-b510-cf29ad8c644c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:27.053192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b69b3-32fd-4e5c-b510-cf29ad8c644c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:27.054650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b69b3-32fd-4e5c-b510-cf29ad8c644c service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:27.064578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1025/2037] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:27.462585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fcb9b-c860-4059-b7a5-1ed677818ee8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:27.464291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-089fcb9b-c860-4059-b7a5-1ed677818ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:27.487578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fcb9b-c860-4059-b7a5-1ed677818ee8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:27.499826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:27.500992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:27.501283 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:27.501743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] PATH_INFO: `/v3/projects/879ff4a41ee94a169895df092d7d7716` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:27.503607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] RBAC: Authorizing `identity:delete_project(project_id=879ff4a41ee94a169895df092d7d7716)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:27.527240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:27.606648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879ff4a41ee94a169895df092d7d7716', 'request_id': 'req-2757f736-d437-4c69-8ba8-dfc1e54c836d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.624682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879ff4a41ee94a169895df092d7d7716', 'request_id': 'req-2757f736-d437-4c69-8ba8-dfc1e54c836d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.633954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879ff4a41ee94a169895df092d7d7716', 'request_id': 'req-2757f736-d437-4c69-8ba8-dfc1e54c836d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.647376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] The token cache is being invalidate because project 879ff4a41ee94a169895df092d7d7716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:27.647833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.648675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.650441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1013/2038] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:27 2022] DELETE /identity/v3/projects/879ff4a41ee94a169895df092d7d7716 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:27.655667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b69b3-32fd-4e5c-b510-cf29ad8c644c service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:27.667422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b69b3-32fd-4e5c-b510-cf29ad8c644c service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:27.734167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:27.734972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:27.735252 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:27.735529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] PATH_INFO: `/v3/users/ce774dcd5e464ab58faece95feb2dafb` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:27.736731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce774dcd5e464ab58faece95feb2dafb)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:27.738700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:27.796881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce774dcd5e464ab58faece95feb2dafb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.797834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce774dcd5e464ab58faece95feb2dafb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.798749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce774dcd5e464ab58faece95feb2dafb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.836797 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce774dcd5e464ab58faece95feb2dafb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.844501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-09ee9b70-cf77-4ada-b15b-ab9fd09bd985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce774dcd5e464ab58faece95feb2dafb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:27.858726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1026/2039] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:27 2022] DELETE /identity/v3/users/ce774dcd5e464ab58faece95feb2dafb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:28.186841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:28.188300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:28.203427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757f736-d437-4c69-8ba8-dfc1e54c836d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:28.275607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:28.276398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.276680 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.276958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] PATH_INFO: `/v3/projects/e692de7733b74f1b8e113730d7e40ad9` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.278164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e692de7733b74f1b8e113730d7e40ad9)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:28.280959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:28.313750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:28.340210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e692de7733b74f1b8e113730d7e40ad9', 'request_id': 'req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:28.349360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e692de7733b74f1b8e113730d7e40ad9', 'request_id': 'req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:28.356569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e692de7733b74f1b8e113730d7e40ad9', 'request_id': 'req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:28.368717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] The token cache is being invalidate because project e692de7733b74f1b8e113730d7e40ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:28.369014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:28.369691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-1c04b897-9fb4-485f-8a86-3e45a9ee5a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:28.371378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1014/2040] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:28 2022] DELETE /identity/v3/projects/e692de7733b74f1b8e113730d7e40ad9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:28.377858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e79e7-dc47-4bb3-bf03-38a4fc96cf1b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.378412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e79e7-dc47-4bb3-bf03-38a4fc96cf1b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.378782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e79e7-dc47-4bb3-bf03-38a4fc96cf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.400269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ba1e79e7-dc47-4bb3-bf03-38a4fc96cf1b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:28.401624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ba1e79e7-dc47-4bb3-bf03-38a4fc96cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:28.454303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:28.486582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1027/2041] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:28.496026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e14154-1414-460f-b135-f8b6ea3d46b0 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.496499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e14154-1414-460f-b135-f8b6ea3d46b0 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.496990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e14154-1414-460f-b135-f8b6ea3d46b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.532627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b2e14154-1414-460f-b135-f8b6ea3d46b0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:28.533886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b2e14154-1414-460f-b135-f8b6ea3d46b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:28.542906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1015/2042] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:28.547396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e79e7-dc47-4bb3-bf03-38a4fc96cf1b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:28.560597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e79e7-dc47-4bb3-bf03-38a4fc96cf1b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:28.566498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e966b-0fea-4e5c-81c9-1b43d0b079e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:28.567379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e966b-0fea-4e5c-81c9-1b43d0b079e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.567787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e966b-0fea-4e5c-81c9-1b43d0b079e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.568217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e966b-0fea-4e5c-81c9-1b43d0b079e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.569063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e966b-0fea-4e5c-81c9-1b43d0b079e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:28.569434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e966b-0fea-4e5c-81c9-1b43d0b079e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:28.571268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e966b-0fea-4e5c-81c9-1b43d0b079e8 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:28.585664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1028/2043] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:28.590104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e14154-1414-460f-b135-f8b6ea3d46b0 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:28.599706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e14154-1414-460f-b135-f8b6ea3d46b0 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:28.604656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28081183-a1f9-4693-8c57-06b7f329cb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:28.605478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28081183-a1f9-4693-8c57-06b7f329cb6f admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.605762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28081183-a1f9-4693-8c57-06b7f329cb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.606041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28081183-a1f9-4693-8c57-06b7f329cb6f admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.606874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28081183-a1f9-4693-8c57-06b7f329cb6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:28.608940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28081183-a1f9-4693-8c57-06b7f329cb6f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:28.653435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1016/2044] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:28 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:28.657525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e966b-0fea-4e5c-81c9-1b43d0b079e8 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:28.677973 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e966b-0fea-4e5c-81c9-1b43d0b079e8 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:28.744866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50bfd9-7225-4c65-a362-7371b094a615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:28.746239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50bfd9-7225-4c65-a362-7371b094a615 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.746557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50bfd9-7225-4c65-a362-7371b094a615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.746838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50bfd9-7225-4c65-a362-7371b094a615 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.748070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50bfd9-7225-4c65-a362-7371b094a615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:28.750151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50bfd9-7225-4c65-a362-7371b094a615 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:28.771113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1029/2045] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:28 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:28.775303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28081183-a1f9-4693-8c57-06b7f329cb6f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:28.786570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28081183-a1f9-4693-8c57-06b7f329cb6f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:28.791202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f93b-1c16-4218-92c4-48c67a844120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:28.791852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f93b-1c16-4218-92c4-48c67a844120 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.792135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f93b-1c16-4218-92c4-48c67a844120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.792409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82f93b-1c16-4218-92c4-48c67a844120 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.793126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82f93b-1c16-4218-92c4-48c67a844120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:28.795450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82f93b-1c16-4218-92c4-48c67a844120 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:28.806440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1017/2046] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:28.811000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50bfd9-7225-4c65-a362-7371b094a615 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:28.820779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50bfd9-7225-4c65-a362-7371b094a615 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:28.826166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e5e19-7df7-40a6-a0e4-e455029e8103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:28.826941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5e19-7df7-40a6-a0e4-e455029e8103 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.827230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5e19-7df7-40a6-a0e4-e455029e8103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.827510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e5e19-7df7-40a6-a0e4-e455029e8103 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.828232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5e19-7df7-40a6-a0e4-e455029e8103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:28.829825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e5e19-7df7-40a6-a0e4-e455029e8103 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:28.839771 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1030/2047] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:28.844088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f93b-1c16-4218-92c4-48c67a844120 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:28.854343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82f93b-1c16-4218-92c4-48c67a844120 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:28.859888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae568ed-3535-43e6-955d-a336ccd0343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:28.860800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae568ed-3535-43e6-955d-a336ccd0343f admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.861085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae568ed-3535-43e6-955d-a336ccd0343f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.861361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae568ed-3535-43e6-955d-a336ccd0343f admin admin] PATH_INFO: `/v3/projects/4d083a10bf6e432586abde988ff99120/users/461091e732d54b69add7cc9001de5118/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.880059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae568ed-3535-43e6-955d-a336ccd0343f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d083a10bf6e432586abde988ff99120, user_id=461091e732d54b69add7cc9001de5118, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:28.882936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae568ed-3535-43e6-955d-a336ccd0343f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:28.912618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1018/2048] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:28 2022] PUT /identity/v3/projects/4d083a10bf6e432586abde988ff99120/users/461091e732d54b69add7cc9001de5118/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:28.914466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07643-4adb-4530-9f0c-c8797c71f8c8 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:28.915330 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07643-4adb-4530-9f0c-c8797c71f8c8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:28.915330 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07643-4adb-4530-9f0c-c8797c71f8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:28.955776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-79a07643-4adb-4530-9f0c-c8797c71f8c8 None None] MFA Rules not processed for user `461091e732d54b69add7cc9001de5118`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:28.957000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-79a07643-4adb-4530-9f0c-c8797c71f8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:29.025398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1031/2049] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:29.029809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae568ed-3535-43e6-955d-a336ccd0343f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.102907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae568ed-3535-43e6-955d-a336ccd0343f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.108426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0ec49-369d-4a2b-a3ef-6ce1718a7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.109088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0ec49-369d-4a2b-a3ef-6ce1718a7fbf admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.109368 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0ec49-369d-4a2b-a3ef-6ce1718a7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.109649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0ec49-369d-4a2b-a3ef-6ce1718a7fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.110383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0ec49-369d-4a2b-a3ef-6ce1718a7fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.112315 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0ec49-369d-4a2b-a3ef-6ce1718a7fbf admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.139371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1019/2050] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:29 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:29.143314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a07643-4adb-4530-9f0c-c8797c71f8c8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.154734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a07643-4adb-4530-9f0c-c8797c71f8c8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.208727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:29.227558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19c180-497a-450f-8df9-93b9bb158bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.228195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19c180-497a-450f-8df9-93b9bb158bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.228555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19c180-497a-450f-8df9-93b9bb158bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.229584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19c180-497a-450f-8df9-93b9bb158bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.229785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19c180-497a-450f-8df9-93b9bb158bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.232511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19c180-497a-450f-8df9-93b9bb158bf1 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.268746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1032/2051] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:29 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:29.270306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0ec49-369d-4a2b-a3ef-6ce1718a7fbf admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.282534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0ec49-369d-4a2b-a3ef-6ce1718a7fbf admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.287485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a512d8-8ff4-4205-9a26-4ec84aa7e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.288230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a512d8-8ff4-4205-9a26-4ec84aa7e97d admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.288590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a512d8-8ff4-4205-9a26-4ec84aa7e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.288940 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a512d8-8ff4-4205-9a26-4ec84aa7e97d admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.289744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a512d8-8ff4-4205-9a26-4ec84aa7e97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.294979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a512d8-8ff4-4205-9a26-4ec84aa7e97d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.307428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1020/2052] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:29.312315 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19c180-497a-450f-8df9-93b9bb158bf1 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.323298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19c180-497a-450f-8df9-93b9bb158bf1 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.329268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904a8c1-5519-494d-b01d-b3b2ef0a4f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.330153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904a8c1-5519-494d-b01d-b3b2ef0a4f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.330473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904a8c1-5519-494d-b01d-b3b2ef0a4f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.330749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904a8c1-5519-494d-b01d-b3b2ef0a4f35 admin admin] PATH_INFO: `/v3/projects/18c8c4a857ce444da053569e0fc4d527/users/e25d451db0ce4634a18ba3c19d2e7ef0/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.348848 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904a8c1-5519-494d-b01d-b3b2ef0a4f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c8c4a857ce444da053569e0fc4d527, user_id=e25d451db0ce4634a18ba3c19d2e7ef0, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.351376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904a8c1-5519-494d-b01d-b3b2ef0a4f35 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.372328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1033/2053] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:29 2022] PUT /identity/v3/projects/18c8c4a857ce444da053569e0fc4d527/users/e25d451db0ce4634a18ba3c19d2e7ef0/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:29.374843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a512d8-8ff4-4205-9a26-4ec84aa7e97d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.389495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a512d8-8ff4-4205-9a26-4ec84aa7e97d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.417130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:29.459077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d1c88-5bdb-4351-8fbd-44df14596b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.459740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d1c88-5bdb-4351-8fbd-44df14596b48 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.460027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d1c88-5bdb-4351-8fbd-44df14596b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.460306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d1c88-5bdb-4351-8fbd-44df14596b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.461033 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d1c88-5bdb-4351-8fbd-44df14596b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.462719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d1c88-5bdb-4351-8fbd-44df14596b48 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.472929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1021/2054] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:51:29.477114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904a8c1-5519-494d-b01d-b3b2ef0a4f35 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.488596 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904a8c1-5519-494d-b01d-b3b2ef0a4f35 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.493645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490dbd55-f981-46a5-8efa-c72294f05319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.494560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dbd55-f981-46a5-8efa-c72294f05319 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.494846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dbd55-f981-46a5-8efa-c72294f05319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.495123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490dbd55-f981-46a5-8efa-c72294f05319 admin admin] PATH_INFO: `/v3/projects/18c8c4a857ce444da053569e0fc4d527/users/e25d451db0ce4634a18ba3c19d2e7ef0/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.497185 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490dbd55-f981-46a5-8efa-c72294f05319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c8c4a857ce444da053569e0fc4d527, user_id=e25d451db0ce4634a18ba3c19d2e7ef0, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.500502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490dbd55-f981-46a5-8efa-c72294f05319 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.524313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1034/2055] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:29 2022] PUT /identity/v3/projects/18c8c4a857ce444da053569e0fc4d527/users/e25d451db0ce4634a18ba3c19d2e7ef0/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:29.527314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724e1d7-47a6-41e0-b188-4c3c82aeeb01 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.527314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724e1d7-47a6-41e0-b188-4c3c82aeeb01 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.527314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724e1d7-47a6-41e0-b188-4c3c82aeeb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.565764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0724e1d7-47a6-41e0-b188-4c3c82aeeb01 None None] MFA Rules not processed for user `e25d451db0ce4634a18ba3c19d2e7ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:29.567165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0724e1d7-47a6-41e0-b188-4c3c82aeeb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:29.653271 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1022/2056] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:29.664850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490dbd55-f981-46a5-8efa-c72294f05319 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.666731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-490dbd55-f981-46a5-8efa-c72294f05319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:29.727411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490dbd55-f981-46a5-8efa-c72294f05319 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.731040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c1b80-8e8e-484d-b2b1-d8af6c5e1013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.731687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1b80-8e8e-484d-b2b1-d8af6c5e1013 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.732506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1b80-8e8e-484d-b2b1-d8af6c5e1013 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.732792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c1b80-8e8e-484d-b2b1-d8af6c5e1013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.742415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1b80-8e8e-484d-b2b1-d8af6c5e1013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.743860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c1b80-8e8e-484d-b2b1-d8af6c5e1013 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.755002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1035/2057] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:30.229759 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724e1d7-47a6-41e0-b188-4c3c82aeeb01 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:30.292552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724e1d7-47a6-41e0-b188-4c3c82aeeb01 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:30.298082 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:30.299006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:30.299286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:30.299575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] PATH_INFO: `/v3/users/461091e732d54b69add7cc9001de5118` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:30.300768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=461091e732d54b69add7cc9001de5118)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:30.302752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:30.348389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '461091e732d54b69add7cc9001de5118'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.348961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '461091e732d54b69add7cc9001de5118'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.350111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:30.363356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '461091e732d54b69add7cc9001de5118'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.370279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '461091e732d54b69add7cc9001de5118'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.379540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '461091e732d54b69add7cc9001de5118'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.388115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1023/2058] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:30 2022] DELETE /identity/v3/users/461091e732d54b69add7cc9001de5118 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:30.392637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b21b-feea-4ddf-a34e-a6d1e71d542b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:30.393203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b21b-feea-4ddf-a34e-a6d1e71d542b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:30.393550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4b21b-feea-4ddf-a34e-a6d1e71d542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:30.412683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-12f4b21b-feea-4ddf-a34e-a6d1e71d542b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:30.413910 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-12f4b21b-feea-4ddf-a34e-a6d1e71d542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:30.476412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1036/2059] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:30.486745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:30.488177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:30.556824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f0e63-c11f-42df-a172-904835b97f86 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:30.561629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab6f2-a746-4d6c-9c9f-d5dea34338ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:30.562289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab6f2-a746-4d6c-9c9f-d5dea34338ac service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:30.562615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab6f2-a746-4d6c-9c9f-d5dea34338ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:30.562913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab6f2-a746-4d6c-9c9f-d5dea34338ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:30.572885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aab6f2-a746-4d6c-9c9f-d5dea34338ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:30.574380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aab6f2-a746-4d6c-9c9f-d5dea34338ac service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:30.585009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1024/2060] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:51:30.866960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b21b-feea-4ddf-a34e-a6d1e71d542b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:30.868646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-12f4b21b-feea-4ddf-a34e-a6d1e71d542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:30.883456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4b21b-feea-4ddf-a34e-a6d1e71d542b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:30.889495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:30.890640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:30.891027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:30.891403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] PATH_INFO: `/v3/projects/4d083a10bf6e432586abde988ff99120` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:30.892762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d083a10bf6e432586abde988ff99120)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:30.894957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:30.933556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:30.945037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d083a10bf6e432586abde988ff99120', 'request_id': 'req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.953599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d083a10bf6e432586abde988ff99120', 'request_id': 'req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.960060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d083a10bf6e432586abde988ff99120', 'request_id': 'req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.971844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] The token cache is being invalidate because project 4d083a10bf6e432586abde988ff99120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:30.972131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.972800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:30.974393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1037/2061] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:30 2022] DELETE /identity/v3/projects/4d083a10bf6e432586abde988ff99120 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:30.979173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab6f2-a746-4d6c-9c9f-d5dea34338ac service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:30.990461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab6f2-a746-4d6c-9c9f-d5dea34338ac service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:31.049545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:31.050495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.050785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.051063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] PATH_INFO: `/v3/users/e25d451db0ce4634a18ba3c19d2e7ef0` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.052335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25d451db0ce4634a18ba3c19d2e7ef0)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:31.054285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:31.101714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25d451db0ce4634a18ba3c19d2e7ef0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.102411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25d451db0ce4634a18ba3c19d2e7ef0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.114375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25d451db0ce4634a18ba3c19d2e7ef0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.118822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:31.123081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25d451db0ce4634a18ba3c19d2e7ef0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.130635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9e0a2e28-bee5-4d3a-8e74-d7cfd2ffda03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25d451db0ce4634a18ba3c19d2e7ef0'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.136669 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1025/2062] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:30 2022] DELETE /identity/v3/users/e25d451db0ce4634a18ba3c19d2e7ef0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:31.408507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:31.410533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:31.446857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da18c4-3ebe-41ed-8bc0-87cae418eb4f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:31.504125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:31.504978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.505286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.505561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] PATH_INFO: `/v3/projects/18c8c4a857ce444da053569e0fc4d527` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.506767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c8c4a857ce444da053569e0fc4d527)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:31.508657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:31.557795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c8c4a857ce444da053569e0fc4d527', 'request_id': 'req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.566064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c8c4a857ce444da053569e0fc4d527', 'request_id': 'req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.572970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c8c4a857ce444da053569e0fc4d527', 'request_id': 'req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.584373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] The token cache is being invalidate because project 18c8c4a857ce444da053569e0fc4d527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:31.584663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.585322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d8bbca6d-6c9c-4467-a4d4-757a3aedeb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:31.586950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1038/2063] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:31 2022] DELETE /identity/v3/projects/18c8c4a857ce444da053569e0fc4d527 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:31.592409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221848-3fe7-42c9-837e-18ce04bf6043 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.592899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221848-3fe7-42c9-837e-18ce04bf6043 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.593091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221848-3fe7-42c9-837e-18ce04bf6043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.613789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a7221848-3fe7-42c9-837e-18ce04bf6043 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:31.615183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a7221848-3fe7-42c9-837e-18ce04bf6043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:31.683684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1026/2064] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:51:31.692743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6d02d-f50a-474b-9ea0-055b8ee12182 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.693094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6d02d-f50a-474b-9ea0-055b8ee12182 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.693464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6d02d-f50a-474b-9ea0-055b8ee12182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.713210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0dd6d02d-f50a-474b-9ea0-055b8ee12182 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:31.714445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0dd6d02d-f50a-474b-9ea0-055b8ee12182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:31.723219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1039/2065] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:31.727553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7221848-3fe7-42c9-837e-18ce04bf6043 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:31.738130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7221848-3fe7-42c9-837e-18ce04bf6043 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:31.742739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3322328-9780-4d04-901a-7ed1685fc1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:31.743391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322328-9780-4d04-901a-7ed1685fc1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.743674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322328-9780-4d04-901a-7ed1685fc1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.743951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3322328-9780-4d04-901a-7ed1685fc1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.744680 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3322328-9780-4d04-901a-7ed1685fc1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:31.744981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3322328-9780-4d04-901a-7ed1685fc1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:31.746602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3322328-9780-4d04-901a-7ed1685fc1c0 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:31.758180 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1027/2066] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:31.762559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6d02d-f50a-474b-9ea0-055b8ee12182 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:31.773423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6d02d-f50a-474b-9ea0-055b8ee12182 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:31.779545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d75a3-8cea-428f-9963-95d1a5e2b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:31.780437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d75a3-8cea-428f-9963-95d1a5e2b893 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.780780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d75a3-8cea-428f-9963-95d1a5e2b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.781055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d75a3-8cea-428f-9963-95d1a5e2b893 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.781860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d75a3-8cea-428f-9963-95d1a5e2b893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:31.784104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d75a3-8cea-428f-9963-95d1a5e2b893 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:31.814175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1040/2067] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:31 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:31.818341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3322328-9780-4d04-901a-7ed1685fc1c0 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:31.829069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3322328-9780-4d04-901a-7ed1685fc1c0 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:31.883969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c547e3-c37f-473e-8524-b0a1a5127279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:31.884654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c547e3-c37f-473e-8524-b0a1a5127279 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.884936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c547e3-c37f-473e-8524-b0a1a5127279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.885210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c547e3-c37f-473e-8524-b0a1a5127279 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.885898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c547e3-c37f-473e-8524-b0a1a5127279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:31.887885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c547e3-c37f-473e-8524-b0a1a5127279 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:31.908611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1028/2068] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:31 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:31.912421 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d75a3-8cea-428f-9963-95d1a5e2b893 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:31.923685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d75a3-8cea-428f-9963-95d1a5e2b893 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:31.929370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592da665-58f0-4bae-9990-486232b654bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:31.930090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da665-58f0-4bae-9990-486232b654bf admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.930471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da665-58f0-4bae-9990-486232b654bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.931082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592da665-58f0-4bae-9990-486232b654bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.931619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592da665-58f0-4bae-9990-486232b654bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:31.933280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592da665-58f0-4bae-9990-486232b654bf admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:31.944703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1041/2069] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:31.955523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c547e3-c37f-473e-8524-b0a1a5127279 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:31.960268 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c547e3-c37f-473e-8524-b0a1a5127279 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:31.964954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc8b79-d3cc-4a61-9b2f-ef8b433794a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:31.965616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc8b79-d3cc-4a61-9b2f-ef8b433794a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:31.965901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc8b79-d3cc-4a61-9b2f-ef8b433794a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:31.966994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc8b79-d3cc-4a61-9b2f-ef8b433794a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:31.967820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc8b79-d3cc-4a61-9b2f-ef8b433794a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:31.969865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc8b79-d3cc-4a61-9b2f-ef8b433794a6 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:31.981241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1029/2070] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:31.985432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592da665-58f0-4bae-9990-486232b654bf admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:31.996324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592da665-58f0-4bae-9990-486232b654bf admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:32.001236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626779a5-397e-4562-ac82-c58f73abc85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:32.002133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626779a5-397e-4562-ac82-c58f73abc85b admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:32.002487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626779a5-397e-4562-ac82-c58f73abc85b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:32.002874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626779a5-397e-4562-ac82-c58f73abc85b admin admin] PATH_INFO: `/v3/projects/1147159181384bf48782e65e7898c001/users/9e75bf18c72e47818b7b942ad8aa3e4d/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:32.015989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:32.020813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626779a5-397e-4562-ac82-c58f73abc85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1147159181384bf48782e65e7898c001, user_id=9e75bf18c72e47818b7b942ad8aa3e4d, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:32.024524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626779a5-397e-4562-ac82-c58f73abc85b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:32.039383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1042/2071] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:31 2022] PUT /identity/v3/projects/1147159181384bf48782e65e7898c001/users/9e75bf18c72e47818b7b942ad8aa3e4d/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:32.049816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeea42c-04b1-4335-9ca9-7bccac0df2b2 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:32.050102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeea42c-04b1-4335-9ca9-7bccac0df2b2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:32.050404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeea42c-04b1-4335-9ca9-7bccac0df2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:32.077202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-dfeea42c-04b1-4335-9ca9-7bccac0df2b2 None None] MFA Rules not processed for user `9e75bf18c72e47818b7b942ad8aa3e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:32.078428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-dfeea42c-04b1-4335-9ca9-7bccac0df2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:32.122690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:32.150772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1030/2072] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:32.161925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626779a5-397e-4562-ac82-c58f73abc85b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:32.163639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-626779a5-397e-4562-ac82-c58f73abc85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:32.223746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626779a5-397e-4562-ac82-c58f73abc85b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:32.227389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811fe51-29d4-41f8-9a84-582e69f273f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:32.228026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811fe51-29d4-41f8-9a84-582e69f273f0 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:32.228310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811fe51-29d4-41f8-9a84-582e69f273f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:32.228587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811fe51-29d4-41f8-9a84-582e69f273f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:32.237391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811fe51-29d4-41f8-9a84-582e69f273f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:32.238842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811fe51-29d4-41f8-9a84-582e69f273f0 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:32.247735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1043/2073] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:42.147623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=8 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:42.243696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:52.352232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeea42c-04b1-4335-9ca9-7bccac0df2b2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.416899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeea42c-04b1-4335-9ca9-7bccac0df2b2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:52.421488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:52.422375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.422665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.422967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] PATH_INFO: `/v3/users/9e75bf18c72e47818b7b942ad8aa3e4d` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.425038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e75bf18c72e47818b7b942ad8aa3e4d)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:52.427036 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:52.482148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e75bf18c72e47818b7b942ad8aa3e4d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:52.482923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e75bf18c72e47818b7b942ad8aa3e4d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:52.496134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e75bf18c72e47818b7b942ad8aa3e4d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:52.503883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e75bf18c72e47818b7b942ad8aa3e4d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:52.511446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e75bf18c72e47818b7b942ad8aa3e4d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:52.517849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1031/2074] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:51:52 2022] DELETE /identity/v3/users/9e75bf18c72e47818b7b942ad8aa3e4d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:51:52.522598 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85986b-fef9-49b8-8938-684406db6555 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.523316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85986b-fef9-49b8-8938-684406db6555 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.523527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85986b-fef9-49b8-8938-684406db6555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.543837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0f85986b-fef9-49b8-8938-684406db6555 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:52.545063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0f85986b-fef9-49b8-8938-684406db6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:52.605668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1044/2075] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:52.615843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.617284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:52.677527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee7f2f-e891-49ed-8e21-7dcebd07401d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:52.681177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078ac3-c543-424e-b7b6-04df2b2c5d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:52.681822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078ac3-c543-424e-b7b6-04df2b2c5d01 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.682108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078ac3-c543-424e-b7b6-04df2b2c5d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.682419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078ac3-c543-424e-b7b6-04df2b2c5d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.692138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90078ac3-c543-424e-b7b6-04df2b2c5d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:52.693566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90078ac3-c543-424e-b7b6-04df2b2c5d01 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:52.703416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1032/2076] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:51:52.983540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85986b-fef9-49b8-8938-684406db6555 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.985069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0f85986b-fef9-49b8-8938-684406db6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:52.998447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85986b-fef9-49b8-8938-684406db6555 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:53.004908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:53.006116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.006475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.006812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] PATH_INFO: `/v3/projects/1147159181384bf48782e65e7898c001` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.007963 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1147159181384bf48782e65e7898c001)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:53.009856 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:53.057142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1147159181384bf48782e65e7898c001', 'request_id': 'req-757c255f-680e-4476-8b52-6474d6aa0658'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:53.064470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1147159181384bf48782e65e7898c001', 'request_id': 'req-757c255f-680e-4476-8b52-6474d6aa0658'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:53.071479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1147159181384bf48782e65e7898c001', 'request_id': 'req-757c255f-680e-4476-8b52-6474d6aa0658'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:53.083495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] The token cache is being invalidate because project 1147159181384bf48782e65e7898c001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:51:53.083944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:53.084757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-757c255f-680e-4476-8b52-6474d6aa0658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:51:53.086948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1045/2077] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:51:52 2022] DELETE /identity/v3/projects/1147159181384bf48782e65e7898c001 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:53.092244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770acdf7-03af-4814-ae4f-7efcf9001ca1 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.092541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770acdf7-03af-4814-ae4f-7efcf9001ca1 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.092828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770acdf7-03af-4814-ae4f-7efcf9001ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.111765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-770acdf7-03af-4814-ae4f-7efcf9001ca1 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:53.112944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-770acdf7-03af-4814-ae4f-7efcf9001ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:53.133478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:53.178923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1033/2078] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:53.186889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec7e37-7526-4504-9783-1a48c96404e8 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.187180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec7e37-7526-4504-9783-1a48c96404e8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.187486 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec7e37-7526-4504-9783-1a48c96404e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.207041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-feec7e37-7526-4504-9783-1a48c96404e8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:53.208228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-feec7e37-7526-4504-9783-1a48c96404e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:53.215957 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1046/2079] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:53.221039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770acdf7-03af-4814-ae4f-7efcf9001ca1 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:53.231092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770acdf7-03af-4814-ae4f-7efcf9001ca1 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:53.235803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb42ff9-0542-4582-9f8e-395c20aac0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:53.236449 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42ff9-0542-4582-9f8e-395c20aac0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.236734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42ff9-0542-4582-9f8e-395c20aac0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.237013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb42ff9-0542-4582-9f8e-395c20aac0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.237736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb42ff9-0542-4582-9f8e-395c20aac0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:53.238047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb42ff9-0542-4582-9f8e-395c20aac0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:53.239706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb42ff9-0542-4582-9f8e-395c20aac0a8 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:53.251132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1034/2080] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:53.255345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec7e37-7526-4504-9783-1a48c96404e8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:53.264668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec7e37-7526-4504-9783-1a48c96404e8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:53.269840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764bcdc-18de-4ffd-b000-60bb42e0a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:53.270511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764bcdc-18de-4ffd-b000-60bb42e0a761 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.270820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764bcdc-18de-4ffd-b000-60bb42e0a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.271127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764bcdc-18de-4ffd-b000-60bb42e0a761 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.271817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764bcdc-18de-4ffd-b000-60bb42e0a761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:53.273752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764bcdc-18de-4ffd-b000-60bb42e0a761 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:53.299924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1047/2081] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:51:53 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:53.303679 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb42ff9-0542-4582-9f8e-395c20aac0a8 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:53.315749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb42ff9-0542-4582-9f8e-395c20aac0a8 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:53.373498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235042c-b6db-4c2b-8a7b-ae8f84f20cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:53.374159 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235042c-b6db-4c2b-8a7b-ae8f84f20cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.374365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235042c-b6db-4c2b-8a7b-ae8f84f20cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.374643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235042c-b6db-4c2b-8a7b-ae8f84f20cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.375329 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235042c-b6db-4c2b-8a7b-ae8f84f20cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:53.377260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235042c-b6db-4c2b-8a7b-ae8f84f20cd3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:53.396766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1035/2082] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:51:53 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:51:53.401016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764bcdc-18de-4ffd-b000-60bb42e0a761 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:53.412179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764bcdc-18de-4ffd-b000-60bb42e0a761 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:53.416867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35529b47-fc2f-4571-9d42-8684613be232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:53.417516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35529b47-fc2f-4571-9d42-8684613be232 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.417809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35529b47-fc2f-4571-9d42-8684613be232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.418163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35529b47-fc2f-4571-9d42-8684613be232 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.418938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35529b47-fc2f-4571-9d42-8684613be232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:53.420536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35529b47-fc2f-4571-9d42-8684613be232 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:53.430958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1048/2083] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:53.434886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235042c-b6db-4c2b-8a7b-ae8f84f20cd3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:53.444861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235042c-b6db-4c2b-8a7b-ae8f84f20cd3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:53.450087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1860667-4bf1-4c62-bf31-23c9ece30c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:53.450807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860667-4bf1-4c62-bf31-23c9ece30c9e admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.451097 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860667-4bf1-4c62-bf31-23c9ece30c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.451380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1860667-4bf1-4c62-bf31-23c9ece30c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.452112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1860667-4bf1-4c62-bf31-23c9ece30c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:53.453710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1860667-4bf1-4c62-bf31-23c9ece30c9e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:53.467691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1036/2084] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:51:53.472245 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35529b47-fc2f-4571-9d42-8684613be232 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:53.484011 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35529b47-fc2f-4571-9d42-8684613be232 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:53.489656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa495e-3834-49a6-8e35-39e7726ad842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:53.490563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa495e-3834-49a6-8e35-39e7726ad842 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.490847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa495e-3834-49a6-8e35-39e7726ad842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.491130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa495e-3834-49a6-8e35-39e7726ad842 admin admin] PATH_INFO: `/v3/projects/7a279b544fe14a4db6a2b964798f4583/users/42568ed33215458f8514e19c6574aee8/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.508285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa495e-3834-49a6-8e35-39e7726ad842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a279b544fe14a4db6a2b964798f4583, user_id=42568ed33215458f8514e19c6574aee8, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:53.511561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa495e-3834-49a6-8e35-39e7726ad842 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:53.534341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1049/2085] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:51:53 2022] PUT /identity/v3/projects/7a279b544fe14a4db6a2b964798f4583/users/42568ed33215458f8514e19c6574aee8/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:53.547043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc71da8-36e5-4060-b20d-cad59a181bd1 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.547603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc71da8-36e5-4060-b20d-cad59a181bd1 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.548384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc71da8-36e5-4060-b20d-cad59a181bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.585170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0cc71da8-36e5-4060-b20d-cad59a181bd1 None None] MFA Rules not processed for user `42568ed33215458f8514e19c6574aee8`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:53.586476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0cc71da8-36e5-4060-b20d-cad59a181bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:53.655656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1037/2086] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:51:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:51:53.666901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa495e-3834-49a6-8e35-39e7726ad842 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:53.668582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-86fa495e-3834-49a6-8e35-39e7726ad842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:53.691228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:53.728423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa495e-3834-49a6-8e35-39e7726ad842 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:53.732126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a69cd0-ca76-4e74-9cda-e05a40d52757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:53.732756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69cd0-ca76-4e74-9cda-e05a40d52757 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:53.733064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69cd0-ca76-4e74-9cda-e05a40d52757 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:53.733342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69cd0-ca76-4e74-9cda-e05a40d52757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:53.741745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a69cd0-ca76-4e74-9cda-e05a40d52757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:53.743218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a69cd0-ca76-4e74-9cda-e05a40d52757 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:53.752422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1050/2087] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:51:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:03.652687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:03.747974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=17 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:11.255226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc71da8-36e5-4060-b20d-cad59a181bd1 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:11.317920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc71da8-36e5-4060-b20d-cad59a181bd1 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:11.322492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:11.323603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:11.323884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:11.324172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] PATH_INFO: `/v3/users/42568ed33215458f8514e19c6574aee8` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:11.325379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42568ed33215458f8514e19c6574aee8)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:11.327345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:11.373136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42568ed33215458f8514e19c6574aee8'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:11.373787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42568ed33215458f8514e19c6574aee8'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:11.387023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42568ed33215458f8514e19c6574aee8'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:11.394588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42568ed33215458f8514e19c6574aee8'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:11.402748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42568ed33215458f8514e19c6574aee8'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:11.409003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1038/2088] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:11 2022] DELETE /identity/v3/users/42568ed33215458f8514e19c6574aee8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:11.413522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d5aa-4d6b-4398-91cf-d6b860d5416a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:11.414001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d5aa-4d6b-4398-91cf-d6b860d5416a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:11.414094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3d5aa-4d6b-4398-91cf-d6b860d5416a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:11.431632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-26b3d5aa-4d6b-4398-91cf-d6b860d5416a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:11.432829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-26b3d5aa-4d6b-4398-91cf-d6b860d5416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:11.493159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1051/2089] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:11.503704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:11.505146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:11.573480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9d21-eb1a-4fda-a916-706db27e4a15 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:11.578568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e753-db95-42c9-a1b3-ced076a005cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:11.579217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e753-db95-42c9-a1b3-ced076a005cf service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:11.579496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e753-db95-42c9-a1b3-ced076a005cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:11.579773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124e753-db95-42c9-a1b3-ced076a005cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:11.591355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e753-db95-42c9-a1b3-ced076a005cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:11.592925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124e753-db95-42c9-a1b3-ced076a005cf service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:11.605806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1039/2090] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:11.879765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d5aa-4d6b-4398-91cf-d6b860d5416a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:11.883920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-26b3d5aa-4d6b-4398-91cf-d6b860d5416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:11.898104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3d5aa-4d6b-4398-91cf-d6b860d5416a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:11.905750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:11.906966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:11.907418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:11.907863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] PATH_INFO: `/v3/projects/7a279b544fe14a4db6a2b964798f4583` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:11.910492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a279b544fe14a4db6a2b964798f4583)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:11.912766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:11.970595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e753-db95-42c9-a1b3-ced076a005cf service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:11.973049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8124e753-db95-42c9-a1b3-ced076a005cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:11.987402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124e753-db95-42c9-a1b3-ced076a005cf service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:11.990948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a279b544fe14a4db6a2b964798f4583', 'request_id': 'req-1d85fd00-1de3-4339-9328-b6a864ff02f2'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:11.999366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a279b544fe14a4db6a2b964798f4583', 'request_id': 'req-1d85fd00-1de3-4339-9328-b6a864ff02f2'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:12.007324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a279b544fe14a4db6a2b964798f4583', 'request_id': 'req-1d85fd00-1de3-4339-9328-b6a864ff02f2'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:12.013611 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:12.019206 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] The token cache is being invalidate because project 7a279b544fe14a4db6a2b964798f4583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:12.019612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:12.020361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1d85fd00-1de3-4339-9328-b6a864ff02f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:12.022349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1052/2091] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:11 2022] DELETE /identity/v3/projects/7a279b544fe14a4db6a2b964798f4583 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:12.027205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d473d8-bcb1-42c7-ba92-06b080e617e4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.027589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d473d8-bcb1-42c7-ba92-06b080e617e4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.027969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d473d8-bcb1-42c7-ba92-06b080e617e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.048601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-18d473d8-bcb1-42c7-ba92-06b080e617e4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:12.050552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-18d473d8-bcb1-42c7-ba92-06b080e617e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:12.058966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:12.059846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.060136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.060417 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] PATH_INFO: `/v3/users/99b002e85d464be18f7836c82ece354f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.061639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b002e85d464be18f7836c82ece354f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:12.064117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:12.142727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1053/2092] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:12.148371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b002e85d464be18f7836c82ece354f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:12.149845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b002e85d464be18f7836c82ece354f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:12.156394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee835639-2a5e-44a2-a1f5-63ad0b7b2d93 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.156689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee835639-2a5e-44a2-a1f5-63ad0b7b2d93 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.156980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee835639-2a5e-44a2-a1f5-63ad0b7b2d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.166581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b002e85d464be18f7836c82ece354f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:12.179974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ee835639-2a5e-44a2-a1f5-63ad0b7b2d93 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:12.181374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ee835639-2a5e-44a2-a1f5-63ad0b7b2d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:12.182883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b002e85d464be18f7836c82ece354f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:12.192132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1054/2093] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:12.196908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee835639-2a5e-44a2-a1f5-63ad0b7b2d93 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:12.201310 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-5e003cf9-7e74-48fa-a022-a084244c4713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b002e85d464be18f7836c82ece354f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:12.207547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee835639-2a5e-44a2-a1f5-63ad0b7b2d93 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:12.212207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1040/2094] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:11 2022] DELETE /identity/v3/users/99b002e85d464be18f7836c82ece354f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:12.212726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2e30-892f-46fa-a90e-cfb2e1d31105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:12.213683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2e30-892f-46fa-a90e-cfb2e1d31105 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.213979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2e30-892f-46fa-a90e-cfb2e1d31105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.214256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2e30-892f-46fa-a90e-cfb2e1d31105 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.215025 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2e30-892f-46fa-a90e-cfb2e1d31105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:12.215336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2e30-892f-46fa-a90e-cfb2e1d31105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:12.216833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f08e2-12fd-4598-8e3c-7c41e77cb9d6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.217308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f08e2-12fd-4598-8e3c-7c41e77cb9d6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.217420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2e30-892f-46fa-a90e-cfb2e1d31105 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:12.217925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f08e2-12fd-4598-8e3c-7c41e77cb9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.234359 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1055/2095] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:52:12.237391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2e30-892f-46fa-a90e-cfb2e1d31105 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:12.245391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-2c0f08e2-12fd-4598-8e3c-7c41e77cb9d6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:12.247041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2c0f08e2-12fd-4598-8e3c-7c41e77cb9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:12.247462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:12.253318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2e30-892f-46fa-a90e-cfb2e1d31105 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:12.320414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1041/2096] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:12.321585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84aaca-116e-416d-84f2-ae50b63df3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:12.322251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84aaca-116e-416d-84f2-ae50b63df3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.322567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84aaca-116e-416d-84f2-ae50b63df3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.322850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84aaca-116e-416d-84f2-ae50b63df3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.323821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84aaca-116e-416d-84f2-ae50b63df3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:12.326481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84aaca-116e-416d-84f2-ae50b63df3f0 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:12.332502 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f08e2-12fd-4598-8e3c-7c41e77cb9d6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:12.334458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2c0f08e2-12fd-4598-8e3c-7c41e77cb9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:12.356189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1056/2097] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:12 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:12.359949 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84aaca-116e-416d-84f2-ae50b63df3f0 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:12.391929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:12.410719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f08e2-12fd-4598-8e3c-7c41e77cb9d6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:12.433833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84aaca-116e-416d-84f2-ae50b63df3f0 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:12.439497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700fbcc-d87b-400e-9cd9-7f02618b70bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:12.441310 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700fbcc-d87b-400e-9cd9-7f02618b70bf admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.441807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700fbcc-d87b-400e-9cd9-7f02618b70bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.442215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700fbcc-d87b-400e-9cd9-7f02618b70bf admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.443341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700fbcc-d87b-400e-9cd9-7f02618b70bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:12.445755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700fbcc-d87b-400e-9cd9-7f02618b70bf admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:12.483576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1057/2098] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:12 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:12.487929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700fbcc-d87b-400e-9cd9-7f02618b70bf admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:12.499235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bedb8-e75c-4209-8e42-34a4eb5bf2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:12.499883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bedb8-e75c-4209-8e42-34a4eb5bf2ba service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.500174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bedb8-e75c-4209-8e42-34a4eb5bf2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.500423 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700fbcc-d87b-400e-9cd9-7f02618b70bf admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:12.500564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bedb8-e75c-4209-8e42-34a4eb5bf2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.506807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d686b0-439d-4af9-9a68-7b246bdc3bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:12.507641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d686b0-439d-4af9-9a68-7b246bdc3bbb admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.507935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d686b0-439d-4af9-9a68-7b246bdc3bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.508246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d686b0-439d-4af9-9a68-7b246bdc3bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.508972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d686b0-439d-4af9-9a68-7b246bdc3bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:12.510620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d686b0-439d-4af9-9a68-7b246bdc3bbb admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:12.511534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bedb8-e75c-4209-8e42-34a4eb5bf2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:12.514484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bedb8-e75c-4209-8e42-34a4eb5bf2ba service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:12.521826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1058/2099] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:12.527317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d686b0-439d-4af9-9a68-7b246bdc3bbb admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:12.529213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1042/2100] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:12.538991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d686b0-439d-4af9-9a68-7b246bdc3bbb admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:12.544575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd1162-94c6-4cf7-87ad-82a3cc4a3291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:12.545251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd1162-94c6-4cf7-87ad-82a3cc4a3291 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.545539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd1162-94c6-4cf7-87ad-82a3cc4a3291 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.546187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd1162-94c6-4cf7-87ad-82a3cc4a3291 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.546619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd1162-94c6-4cf7-87ad-82a3cc4a3291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:12.548274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd1162-94c6-4cf7-87ad-82a3cc4a3291 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:12.562496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1059/2101] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:12.564181 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bedb8-e75c-4209-8e42-34a4eb5bf2ba service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:12.575858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bedb8-e75c-4209-8e42-34a4eb5bf2ba service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:12.581746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3c5e9-03dd-460f-950e-2e52d8a9d0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:12.582747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3c5e9-03dd-460f-950e-2e52d8a9d0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.583034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3c5e9-03dd-460f-950e-2e52d8a9d0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.583362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3c5e9-03dd-460f-950e-2e52d8a9d0ce admin admin] PATH_INFO: `/v3/projects/9024c2d0554a4270bbc9222800e9dcb6/users/6dbb7fcbd9604a87a8b4dd380ca9cd56/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.609908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3c5e9-03dd-460f-950e-2e52d8a9d0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9024c2d0554a4270bbc9222800e9dcb6, user_id=6dbb7fcbd9604a87a8b4dd380ca9cd56, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:12.614154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3c5e9-03dd-460f-950e-2e52d8a9d0ce admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:12.638441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1043/2102] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:12 2022] PUT /identity/v3/projects/9024c2d0554a4270bbc9222800e9dcb6/users/6dbb7fcbd9604a87a8b4dd380ca9cd56/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:12.643655 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90da4e-896b-4c77-a419-ba681458c595 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.644048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90da4e-896b-4c77-a419-ba681458c595 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.644333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90da4e-896b-4c77-a419-ba681458c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.664974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-7f90da4e-896b-4c77-a419-ba681458c595 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:12.667093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7f90da4e-896b-4c77-a419-ba681458c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:12.723446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:12.734512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1060/2103] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:12.745862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3c5e9-03dd-460f-950e-2e52d8a9d0ce admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:12.817880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3c5e9-03dd-460f-950e-2e52d8a9d0ce admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:12.822556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2e748-28b2-4ed3-98a0-0cc600f2d4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:12.823885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2e748-28b2-4ed3-98a0-0cc600f2d4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:12.824580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2e748-28b2-4ed3-98a0-0cc600f2d4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:12.824862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2e748-28b2-4ed3-98a0-0cc600f2d4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:12.835982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2e748-28b2-4ed3-98a0-0cc600f2d4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:12.837431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2e748-28b2-4ed3-98a0-0cc600f2d4d3 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:12.848010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1044/2104] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:13.291353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90da4e-896b-4c77-a419-ba681458c595 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:13.293913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7f90da4e-896b-4c77-a419-ba681458c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:13.310203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90da4e-896b-4c77-a419-ba681458c595 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:13.318173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:13.325394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.325692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.326533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] PATH_INFO: `/v3/projects/ce2943e715cb4192b3f13b81be7e167a` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.327379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2943e715cb4192b3f13b81be7e167a)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:13.330191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:13.396250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2943e715cb4192b3f13b81be7e167a', 'request_id': 'req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:13.405621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2943e715cb4192b3f13b81be7e167a', 'request_id': 'req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:13.413066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2943e715cb4192b3f13b81be7e167a', 'request_id': 'req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:13.425519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] The token cache is being invalidate because project ce2943e715cb4192b3f13b81be7e167a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:13.425687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:13.426430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2f2a3409-13ff-4f2a-b9b0-ec70d3bdc251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:13.428228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1061/2105] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:13 2022] DELETE /identity/v3/projects/ce2943e715cb4192b3f13b81be7e167a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:13.435653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb3e26-1a7d-4414-b54d-c4b3f7efc882 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.436179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb3e26-1a7d-4414-b54d-c4b3f7efc882 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.436311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb3e26-1a7d-4414-b54d-c4b3f7efc882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.456815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7fdb3e26-1a7d-4414-b54d-c4b3f7efc882 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:13.458120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7fdb3e26-1a7d-4414-b54d-c4b3f7efc882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:13.570214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132cd93-d425-4b53-b87e-a04f99de0d8b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.570735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132cd93-d425-4b53-b87e-a04f99de0d8b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.570815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132cd93-d425-4b53-b87e-a04f99de0d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.573689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1045/2106] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:13.593956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e132cd93-d425-4b53-b87e-a04f99de0d8b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:13.595590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e132cd93-d425-4b53-b87e-a04f99de0d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:13.612320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb3e26-1a7d-4414-b54d-c4b3f7efc882 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:13.612944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1062/2107] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:13.623473 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb3e26-1a7d-4414-b54d-c4b3f7efc882 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:13.629960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf332-252c-4dc2-b3b7-36a8039786fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:13.630966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf332-252c-4dc2-b3b7-36a8039786fd admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.631261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf332-252c-4dc2-b3b7-36a8039786fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.631668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf332-252c-4dc2-b3b7-36a8039786fd admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.632421 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf332-252c-4dc2-b3b7-36a8039786fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:13.632793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf332-252c-4dc2-b3b7-36a8039786fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:13.634590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf332-252c-4dc2-b3b7-36a8039786fd admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:13.652838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1046/2108] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:52:13.657672 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132cd93-d425-4b53-b87e-a04f99de0d8b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:13.668520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132cd93-d425-4b53-b87e-a04f99de0d8b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:13.677801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77acf54-19eb-403e-8aad-586d1b83e88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:13.678545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77acf54-19eb-403e-8aad-586d1b83e88b admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.678801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77acf54-19eb-403e-8aad-586d1b83e88b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.679237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77acf54-19eb-403e-8aad-586d1b83e88b admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.680038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77acf54-19eb-403e-8aad-586d1b83e88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:13.682484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77acf54-19eb-403e-8aad-586d1b83e88b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:13.745907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf332-252c-4dc2-b3b7-36a8039786fd admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:13.757018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1063/2109] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:13 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:13.765218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf332-252c-4dc2-b3b7-36a8039786fd admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:13.772325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:13.862638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b183-f2ee-452b-8082-85f4cdf91bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:13.863384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b183-f2ee-452b-8082-85f4cdf91bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.863757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b183-f2ee-452b-8082-85f4cdf91bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.864041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953b183-f2ee-452b-8082-85f4cdf91bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.864983 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953b183-f2ee-452b-8082-85f4cdf91bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:13.867109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953b183-f2ee-452b-8082-85f4cdf91bf2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:13.899133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1047/2110] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:13 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:13.903487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77acf54-19eb-403e-8aad-586d1b83e88b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:13.918646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77acf54-19eb-403e-8aad-586d1b83e88b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:13.925683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae71a0-4bac-4861-98b6-a37a0784cd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:13.926693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae71a0-4bac-4861-98b6-a37a0784cd9f admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.927214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae71a0-4bac-4861-98b6-a37a0784cd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.927594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae71a0-4bac-4861-98b6-a37a0784cd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.928714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae71a0-4bac-4861-98b6-a37a0784cd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:13.931251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae71a0-4bac-4861-98b6-a37a0784cd9f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:13.948939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1064/2111] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:13.949419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b183-f2ee-452b-8082-85f4cdf91bf2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:13.960492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953b183-f2ee-452b-8082-85f4cdf91bf2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:13.967315 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605017b-a628-4b90-b049-0412ffc23ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:13.968227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605017b-a628-4b90-b049-0412ffc23ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:13.968678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605017b-a628-4b90-b049-0412ffc23ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:13.969159 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605017b-a628-4b90-b049-0412ffc23ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:13.970129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605017b-a628-4b90-b049-0412ffc23ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:13.972559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605017b-a628-4b90-b049-0412ffc23ec1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:13.985792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1048/2112] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:13.990727 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae71a0-4bac-4861-98b6-a37a0784cd9f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:14.002973 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae71a0-4bac-4861-98b6-a37a0784cd9f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:14.009730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23c5a7-e6b0-4398-bc43-d8362f3857b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:14.011482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23c5a7-e6b0-4398-bc43-d8362f3857b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:14.012579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23c5a7-e6b0-4398-bc43-d8362f3857b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:14.013024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23c5a7-e6b0-4398-bc43-d8362f3857b3 admin admin] PATH_INFO: `/v3/projects/e50fab96359a4c0fa871582f6cc80c1f/users/b3f2e2c8f5a243c9ad2b17fd2141927e/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:14.034923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23c5a7-e6b0-4398-bc43-d8362f3857b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50fab96359a4c0fa871582f6cc80c1f, user_id=b3f2e2c8f5a243c9ad2b17fd2141927e, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:14.038561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23c5a7-e6b0-4398-bc43-d8362f3857b3 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:14.072702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1065/2113] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:13 2022] PUT /identity/v3/projects/e50fab96359a4c0fa871582f6cc80c1f/users/b3f2e2c8f5a243c9ad2b17fd2141927e/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:14.075497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04e02f-8756-4351-ac08-403a268fc6c2 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:14.075960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04e02f-8756-4351-ac08-403a268fc6c2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:14.076393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04e02f-8756-4351-ac08-403a268fc6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:14.114620 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-2c04e02f-8756-4351-ac08-403a268fc6c2 None None] MFA Rules not processed for user `b3f2e2c8f5a243c9ad2b17fd2141927e`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:14.116154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2c04e02f-8756-4351-ac08-403a268fc6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:14.223477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1049/2114] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:14.230516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23c5a7-e6b0-4398-bc43-d8362f3857b3 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:14.232246 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0d23c5a7-e6b0-4398-bc43-d8362f3857b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:14.382536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23c5a7-e6b0-4398-bc43-d8362f3857b3 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:14.387872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a89e5-3c87-4bbd-b5e9-5bb33787005c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:14.388471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a89e5-3c87-4bbd-b5e9-5bb33787005c service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:14.388776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a89e5-3c87-4bbd-b5e9-5bb33787005c service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:14.389040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a89e5-3c87-4bbd-b5e9-5bb33787005c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:14.402689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a89e5-3c87-4bbd-b5e9-5bb33787005c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:14.405008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a89e5-3c87-4bbd-b5e9-5bb33787005c service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:14.418469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1066/2115] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:16.828010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ec4e-6bc6-4116-bb99-4384e4673908 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:16.829367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ec4e-6bc6-4116-bb99-4384e4673908 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:16.829866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ec4e-6bc6-4116-bb99-4384e4673908 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:16.832891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1050/2116] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:52:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:52:16.845015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003800c-ebe2-41a8-bd83-64184b2e187f None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:16.845483 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003800c-ebe2-41a8-bd83-64184b2e187f None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:16.845562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003800c-ebe2-41a8-bd83-64184b2e187f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:16.876070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d003800c-ebe2-41a8-bd83-64184b2e187f None None] MFA Rules not processed for user `64ce422f60d64b368df8be61e1065282`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:16.878935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d003800c-ebe2-41a8-bd83-64184b2e187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:16.904250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ec4e-6bc6-4116-bb99-4384e4673908 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:16.906608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-79a0ec4e-6bc6-4116-bb99-4384e4673908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:16.918683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:17.033895 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1067/2117] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:52:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:17.041862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0ec4e-6bc6-4116-bb99-4384e4673908 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:17.044835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003800c-ebe2-41a8-bd83-64184b2e187f None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:17.046203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d003800c-ebe2-41a8-bd83-64184b2e187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:17.057108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:17.057988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:17.058268 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:17.058574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] PATH_INFO: `/v3/users/b982efb5297246ccbf6515cf7bc9dde5` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:17.059803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b982efb5297246ccbf6515cf7bc9dde5)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:17.060522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003800c-ebe2-41a8-bd83-64184b2e187f None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:17.061832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:17.068201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939993c9-6221-4cb6-b0df-6c5e69309e56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:17.068864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939993c9-6221-4cb6-b0df-6c5e69309e56 service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:17.069149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939993c9-6221-4cb6-b0df-6c5e69309e56 service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:17.069429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939993c9-6221-4cb6-b0df-6c5e69309e56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:17.079035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939993c9-6221-4cb6-b0df-6c5e69309e56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:17.081342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939993c9-6221-4cb6-b0df-6c5e69309e56 service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:17.087970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:17.093118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1068/2118] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:52:17.137525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b982efb5297246ccbf6515cf7bc9dde5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.138175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b982efb5297246ccbf6515cf7bc9dde5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.156741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b982efb5297246ccbf6515cf7bc9dde5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.165137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b982efb5297246ccbf6515cf7bc9dde5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.178682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9046b638-f981-43e5-b7b2-1dc2989e4078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b982efb5297246ccbf6515cf7bc9dde5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.191104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1051/2119] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:16 2022] DELETE /identity/v3/users/b982efb5297246ccbf6515cf7bc9dde5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:17.572288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939993c9-6221-4cb6-b0df-6c5e69309e56 service placement] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:17.585066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939993c9-6221-4cb6-b0df-6c5e69309e56 service placement] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:17.655721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:17.656669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:17.656876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:17.657138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] PATH_INFO: `/v3/projects/b14d176a6ae64d38905e5bd43c97c253` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:17.658999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14d176a6ae64d38905e5bd43c97c253)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:17.661033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:17.730537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14d176a6ae64d38905e5bd43c97c253', 'request_id': 'req-311c491d-2354-43b9-95dd-c61e6b2b17e7'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.740445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14d176a6ae64d38905e5bd43c97c253', 'request_id': 'req-311c491d-2354-43b9-95dd-c61e6b2b17e7'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.751070 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14d176a6ae64d38905e5bd43c97c253', 'request_id': 'req-311c491d-2354-43b9-95dd-c61e6b2b17e7'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.766130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] The token cache is being invalidate because project b14d176a6ae64d38905e5bd43c97c253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:17.768322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.769401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-311c491d-2354-43b9-95dd-c61e6b2b17e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:17.771471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1069/2120] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:17 2022] DELETE /identity/v3/projects/b14d176a6ae64d38905e5bd43c97c253 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:17.781798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b948fd-33c2-44f0-b6b8-5eb1dfa41c1c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:17.782191 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b948fd-33c2-44f0-b6b8-5eb1dfa41c1c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:17.782419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b948fd-33c2-44f0-b6b8-5eb1dfa41c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:17.806307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d7b948fd-33c2-44f0-b6b8-5eb1dfa41c1c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:17.807821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d7b948fd-33c2-44f0-b6b8-5eb1dfa41c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:17.906040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1052/2121] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:17.914916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b76ca-00f2-4aa3-90a3-ed7d2c739bb4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:17.915470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b76ca-00f2-4aa3-90a3-ed7d2c739bb4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:17.915853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b76ca-00f2-4aa3-90a3-ed7d2c739bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:17.937110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c84b76ca-00f2-4aa3-90a3-ed7d2c739bb4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:17.938493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c84b76ca-00f2-4aa3-90a3-ed7d2c739bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:17.952194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1070/2122] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:17.953320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b948fd-33c2-44f0-b6b8-5eb1dfa41c1c None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:17.963651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b948fd-33c2-44f0-b6b8-5eb1dfa41c1c None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:17.968504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ab445-65bb-4a78-9872-7a013bc3b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:17.969110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ab445-65bb-4a78-9872-7a013bc3b6cf admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:17.969397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ab445-65bb-4a78-9872-7a013bc3b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:17.969677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ab445-65bb-4a78-9872-7a013bc3b6cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:17.970855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ab445-65bb-4a78-9872-7a013bc3b6cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:17.970855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ab445-65bb-4a78-9872-7a013bc3b6cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:17.972561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ab445-65bb-4a78-9872-7a013bc3b6cf admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:17.986919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1053/2123] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:52:17.991192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b76ca-00f2-4aa3-90a3-ed7d2c739bb4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.000604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b76ca-00f2-4aa3-90a3-ed7d2c739bb4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.007910 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6369b00-0855-4c92-a214-f232688ef838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.008607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6369b00-0855-4c92-a214-f232688ef838 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.008987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6369b00-0855-4c92-a214-f232688ef838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.009270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6369b00-0855-4c92-a214-f232688ef838 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.009967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6369b00-0855-4c92-a214-f232688ef838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.011931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6369b00-0855-4c92-a214-f232688ef838 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.046361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1071/2124] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:17 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:18.047593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ab445-65bb-4a78-9872-7a013bc3b6cf admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.059057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ab445-65bb-4a78-9872-7a013bc3b6cf admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.155162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea779a-bb53-47c6-86d1-e623eb39f675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.156175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea779a-bb53-47c6-86d1-e623eb39f675 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.156773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea779a-bb53-47c6-86d1-e623eb39f675 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.157253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea779a-bb53-47c6-86d1-e623eb39f675 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.159406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea779a-bb53-47c6-86d1-e623eb39f675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.162353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea779a-bb53-47c6-86d1-e623eb39f675 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.188814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1054/2125] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:18 2022] POST /identity/v3/users => generated 302 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:18.193536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6369b00-0855-4c92-a214-f232688ef838 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.201338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:18.205499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6369b00-0855-4c92-a214-f232688ef838 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.213385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93942acb-988f-4ecf-b28f-17f807371611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.214104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93942acb-988f-4ecf-b28f-17f807371611 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.215201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93942acb-988f-4ecf-b28f-17f807371611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.215201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93942acb-988f-4ecf-b28f-17f807371611 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.215835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93942acb-988f-4ecf-b28f-17f807371611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.219805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93942acb-988f-4ecf-b28f-17f807371611 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.235113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1072/2126] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:18.239830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea779a-bb53-47c6-86d1-e623eb39f675 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.265047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea779a-bb53-47c6-86d1-e623eb39f675 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.274272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b18e4-b254-40cf-bdd2-1eadb5baab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.275667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b18e4-b254-40cf-bdd2-1eadb5baab27 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.276040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b18e4-b254-40cf-bdd2-1eadb5baab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.276327 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b18e4-b254-40cf-bdd2-1eadb5baab27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.277080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b18e4-b254-40cf-bdd2-1eadb5baab27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.279751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b18e4-b254-40cf-bdd2-1eadb5baab27 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.293450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:18.310849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1055/2127] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:18.314518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903b06b-0855-43ef-a514-bc94cd9b1efe None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.315416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903b06b-0855-43ef-a514-bc94cd9b1efe None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.315701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903b06b-0855-43ef-a514-bc94cd9b1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.319868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b18e4-b254-40cf-bdd2-1eadb5baab27 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.346725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-5903b06b-0855-43ef-a514-bc94cd9b1efe None None] MFA Rules not processed for user `6dbb7fcbd9604a87a8b4dd380ca9cd56`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:18.347696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b18e4-b254-40cf-bdd2-1eadb5baab27 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.348365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5903b06b-0855-43ef-a514-bc94cd9b1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:18.362046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8523c9-c074-46dd-b9f1-48a2f0d3b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.363895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8523c9-c074-46dd-b9f1-48a2f0d3b5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.364347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8523c9-c074-46dd-b9f1-48a2f0d3b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.364797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8523c9-c074-46dd-b9f1-48a2f0d3b5a6 admin admin] PATH_INFO: `/v3/projects/b3b07ac7f0384fd185c55982f4983392/users/4e1336f0d3e442d086e2c6fdc485d2b6/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.386527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8523c9-c074-46dd-b9f1-48a2f0d3b5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b07ac7f0384fd185c55982f4983392, user_id=4e1336f0d3e442d086e2c6fdc485d2b6, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.390496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8523c9-c074-46dd-b9f1-48a2f0d3b5a6 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.406357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1056/2128] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:18 2022] PUT /identity/v3/projects/b3b07ac7f0384fd185c55982f4983392/users/4e1336f0d3e442d086e2c6fdc485d2b6/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:18.417593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711baa-0f82-4892-8659-61c17ea975b0 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.417951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711baa-0f82-4892-8659-61c17ea975b0 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.418158 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4711baa-0f82-4892-8659-61c17ea975b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.450487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1073/2129] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:18.453956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b4711baa-0f82-4892-8659-61c17ea975b0 None None] MFA Rules not processed for user `4e1336f0d3e442d086e2c6fdc485d2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:18.454360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903b06b-0855-43ef-a514-bc94cd9b1efe None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.455340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b4711baa-0f82-4892-8659-61c17ea975b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:18.455911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5903b06b-0855-43ef-a514-bc94cd9b1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:18.474452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903b06b-0855-43ef-a514-bc94cd9b1efe None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.562187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1057/2130] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:18.567265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711baa-0f82-4892-8659-61c17ea975b0 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.615538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff986e97-5ff0-4e1b-8b2f-2c9627b259d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.616219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986e97-5ff0-4e1b-8b2f-2c9627b259d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.616506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986e97-5ff0-4e1b-8b2f-2c9627b259d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.616786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff986e97-5ff0-4e1b-8b2f-2c9627b259d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.617773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff986e97-5ff0-4e1b-8b2f-2c9627b259d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.619948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff986e97-5ff0-4e1b-8b2f-2c9627b259d8 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.660730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4711baa-0f82-4892-8659-61c17ea975b0 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.669323 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ef961-9c90-49ce-8aec-b3c72164fa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.670428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef961-9c90-49ce-8aec-b3c72164fa5c admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.670894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef961-9c90-49ce-8aec-b3c72164fa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.671166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef961-9c90-49ce-8aec-b3c72164fa5c admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.671898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ef961-9c90-49ce-8aec-b3c72164fa5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.675821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1074/2131] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:18 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:18.675966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ef961-9c90-49ce-8aec-b3c72164fa5c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.677069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff986e97-5ff0-4e1b-8b2f-2c9627b259d8 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.729096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1058/2132] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:18 2022] POST /identity/v3/projects => generated 405 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:18.731454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ef961-9c90-49ce-8aec-b3c72164fa5c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.767688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff986e97-5ff0-4e1b-8b2f-2c9627b259d8 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.783062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:18.799265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:18.815857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ef961-9c90-49ce-8aec-b3c72164fa5c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.821126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915eaa-96f1-4e01-b3db-0810c1828010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.822152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915eaa-96f1-4e01-b3db-0810c1828010 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.822614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915eaa-96f1-4e01-b3db-0810c1828010 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.823026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915eaa-96f1-4e01-b3db-0810c1828010 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.823992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915eaa-96f1-4e01-b3db-0810c1828010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.825958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915eaa-96f1-4e01-b3db-0810c1828010 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.836037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4426e-a43e-41aa-b2c0-faed9185d56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.836772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4426e-a43e-41aa-b2c0-faed9185d56e admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.837015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4426e-a43e-41aa-b2c0-faed9185d56e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.837302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4426e-a43e-41aa-b2c0-faed9185d56e admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.837982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4426e-a43e-41aa-b2c0-faed9185d56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.839961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4426e-a43e-41aa-b2c0-faed9185d56e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.854584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1059/2133] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:18 2022] POST /identity/v3/users => generated 309 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:18.859032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915eaa-96f1-4e01-b3db-0810c1828010 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.863180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1075/2134] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:18 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:18.869307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4426e-a43e-41aa-b2c0-faed9185d56e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.870601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915eaa-96f1-4e01-b3db-0810c1828010 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.875638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad9ac-8af8-4982-8b01-9b3e57289a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.877216 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad9ac-8af8-4982-8b01-9b3e57289a0e admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.878087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad9ac-8af8-4982-8b01-9b3e57289a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.878694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad9ac-8af8-4982-8b01-9b3e57289a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.879218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ad9ac-8af8-4982-8b01-9b3e57289a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.881323 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ad9ac-8af8-4982-8b01-9b3e57289a0e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.884236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4426e-a43e-41aa-b2c0-faed9185d56e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.889819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309a58-16db-42e8-89da-c53c427601bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.890526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309a58-16db-42e8-89da-c53c427601bb admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.890817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309a58-16db-42e8-89da-c53c427601bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.891102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309a58-16db-42e8-89da-c53c427601bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.891837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309a58-16db-42e8-89da-c53c427601bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.892332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1060/2135] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:52:18.894838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309a58-16db-42e8-89da-c53c427601bb admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.897176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad9ac-8af8-4982-8b01-9b3e57289a0e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.912409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad9ac-8af8-4982-8b01-9b3e57289a0e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.920633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1076/2136] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:52:18.925435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309a58-16db-42e8-89da-c53c427601bb admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:18.932783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a95f92-12d8-480f-a268-5a39d93920f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.943872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a95f92-12d8-480f-a268-5a39d93920f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.944257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a95f92-12d8-480f-a268-5a39d93920f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.944626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a95f92-12d8-480f-a268-5a39d93920f6 admin admin] PATH_INFO: `/v3/projects/2ab2237daa8b40bda9e70a951d90cb4e/users/eb19bc08153e4565865d54325e9c0007/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.948587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309a58-16db-42e8-89da-c53c427601bb admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:18.954217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956cb5-6e52-4f64-9803-b049ea6f4772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:18.955972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956cb5-6e52-4f64-9803-b049ea6f4772 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:18.955972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956cb5-6e52-4f64-9803-b049ea6f4772 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:18.956297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7956cb5-6e52-4f64-9803-b049ea6f4772 admin admin] PATH_INFO: `/v3/projects/886f8937cb8446779ec40916ca49a47f/users/bdb094c631b44105b27b6a6e43a1330d/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:18.964443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a95f92-12d8-480f-a268-5a39d93920f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab2237daa8b40bda9e70a951d90cb4e, user_id=eb19bc08153e4565865d54325e9c0007, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.967334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a95f92-12d8-480f-a268-5a39d93920f6 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:18.974016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7956cb5-6e52-4f64-9803-b049ea6f4772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=886f8937cb8446779ec40916ca49a47f, user_id=bdb094c631b44105b27b6a6e43a1330d, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:18.978152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7956cb5-6e52-4f64-9803-b049ea6f4772 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:19.012177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1061/2137] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:18 2022] PUT /identity/v3/projects/2ab2237daa8b40bda9e70a951d90cb4e/users/eb19bc08153e4565865d54325e9c0007/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:19.013138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a95f92-12d8-480f-a268-5a39d93920f6 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:19.016755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1077/2138] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:18 2022] PUT /identity/v3/projects/886f8937cb8446779ec40916ca49a47f/users/bdb094c631b44105b27b6a6e43a1330d/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:19.018394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956cb5-6e52-4f64-9803-b049ea6f4772 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:19.098018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a95f92-12d8-480f-a268-5a39d93920f6 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:19.100207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7956cb5-6e52-4f64-9803-b049ea6f4772 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:19.103261 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22bdc-8dcd-40f4-9bd5-01ecf0eded5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:19.103957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22bdc-8dcd-40f4-9bd5-01ecf0eded5b admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:19.104229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22bdc-8dcd-40f4-9bd5-01ecf0eded5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:19.104513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22bdc-8dcd-40f4-9bd5-01ecf0eded5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:19.105249 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea22bdc-8dcd-40f4-9bd5-01ecf0eded5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:19.105354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b2ab-155d-41f1-8618-9d21727b3eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:19.105968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b2ab-155d-41f1-8618-9d21727b3eff admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:19.106250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b2ab-155d-41f1-8618-9d21727b3eff admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:19.106569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b2ab-155d-41f1-8618-9d21727b3eff admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:19.107055 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea22bdc-8dcd-40f4-9bd5-01ecf0eded5b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:19.107296 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726b2ab-155d-41f1-8618-9d21727b3eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:19.108873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726b2ab-155d-41f1-8618-9d21727b3eff admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:19.119205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1062/2139] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:19.123528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22bdc-8dcd-40f4-9bd5-01ecf0eded5b admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:19.124346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1078/2140] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:19.128680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b2ab-155d-41f1-8618-9d21727b3eff admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:19.134862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22bdc-8dcd-40f4-9bd5-01ecf0eded5b admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:19.139465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b2ab-155d-41f1-8618-9d21727b3eff admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:19.139797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33695932-dff6-4b33-8ee4-113cf992dd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:19.140688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33695932-dff6-4b33-8ee4-113cf992dd83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:19.140976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33695932-dff6-4b33-8ee4-113cf992dd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:19.141258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33695932-dff6-4b33-8ee4-113cf992dd83 admin admin] PATH_INFO: `/v3/projects/2ab2237daa8b40bda9e70a951d90cb4e/users/eb19bc08153e4565865d54325e9c0007/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:19.143997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33695932-dff6-4b33-8ee4-113cf992dd83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab2237daa8b40bda9e70a951d90cb4e, user_id=eb19bc08153e4565865d54325e9c0007, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:19.144899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35772d69-9933-4b58-b636-cdacb249b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:19.145785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35772d69-9933-4b58-b636-cdacb249b2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:19.146067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35772d69-9933-4b58-b636-cdacb249b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:19.146371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35772d69-9933-4b58-b636-cdacb249b2e7 admin admin] PATH_INFO: `/v3/projects/886f8937cb8446779ec40916ca49a47f/users/bdb094c631b44105b27b6a6e43a1330d/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:19.146956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33695932-dff6-4b33-8ee4-113cf992dd83 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:19.148477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35772d69-9933-4b58-b636-cdacb249b2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=886f8937cb8446779ec40916ca49a47f, user_id=bdb094c631b44105b27b6a6e43a1330d, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:19.151224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35772d69-9933-4b58-b636-cdacb249b2e7 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:19.158623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1063/2141] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:19 2022] PUT /identity/v3/projects/2ab2237daa8b40bda9e70a951d90cb4e/users/eb19bc08153e4565865d54325e9c0007/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:19.166051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1079/2142] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:19 2022] PUT /identity/v3/projects/886f8937cb8446779ec40916ca49a47f/users/bdb094c631b44105b27b6a6e43a1330d/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:19.168919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c35bcc-1b70-4bc7-810e-ca622fabb67a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:19.169218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c35bcc-1b70-4bc7-810e-ca622fabb67a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:19.169504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c35bcc-1b70-4bc7-810e-ca622fabb67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:19.204681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-29c35bcc-1b70-4bc7-810e-ca622fabb67a None None] MFA Rules not processed for user `eb19bc08153e4565865d54325e9c0007`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:19.206882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-29c35bcc-1b70-4bc7-810e-ca622fabb67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:19.287345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1064/2143] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:19.298200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35772d69-9933-4b58-b636-cdacb249b2e7 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:19.300665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-35772d69-9933-4b58-b636-cdacb249b2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:19.375673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35772d69-9933-4b58-b636-cdacb249b2e7 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:19.380554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75691b8-b872-45b4-ad88-f2c3adbcd23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:19.381339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75691b8-b872-45b4-ad88-f2c3adbcd23f service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:19.381684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75691b8-b872-45b4-ad88-f2c3adbcd23f service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:19.382065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75691b8-b872-45b4-ad88-f2c3adbcd23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:19.390875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:19.394952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75691b8-b872-45b4-ad88-f2c3adbcd23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:19.397448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75691b8-b872-45b4-ad88-f2c3adbcd23f service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:19.409366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1080/2144] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:19 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:19.656214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c35bcc-1b70-4bc7-810e-ca622fabb67a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:19.699286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:19.810753 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c35bcc-1b70-4bc7-810e-ca622fabb67a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:19.827108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:19.828089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:19.828445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:19.829120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] PATH_INFO: `/v3/users/4e1336f0d3e442d086e2c6fdc485d2b6` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:19.830879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1336f0d3e442d086e2c6fdc485d2b6)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:19.833418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:19.922414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1336f0d3e442d086e2c6fdc485d2b6'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:19.923782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1336f0d3e442d086e2c6fdc485d2b6'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:19.945324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1336f0d3e442d086e2c6fdc485d2b6'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:19.985595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1336f0d3e442d086e2c6fdc485d2b6'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:20.009265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1336f0d3e442d086e2c6fdc485d2b6'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:20.029002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1065/2145] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:19 2022] DELETE /identity/v3/users/4e1336f0d3e442d086e2c6fdc485d2b6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:20.030756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bf56d-947f-46ee-bd9d-d93403140dfa None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:20.031223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bf56d-947f-46ee-bd9d-d93403140dfa None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:20.031510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bf56d-947f-46ee-bd9d-d93403140dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:20.082550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-844bf56d-947f-46ee-bd9d-d93403140dfa None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:20.086389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-844bf56d-947f-46ee-bd9d-d93403140dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:20.218432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1081/2146] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:20.234138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:20.235917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:20.332931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d03060-6053-4da8-9d30-4474bf696788 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:20.337053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ad039-2a57-4f97-855d-0576312d34fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:20.337895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ad039-2a57-4f97-855d-0576312d34fc service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:20.338193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ad039-2a57-4f97-855d-0576312d34fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:20.338517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ad039-2a57-4f97-855d-0576312d34fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:20.368231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ad039-2a57-4f97-855d-0576312d34fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:20.370113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ad039-2a57-4f97-855d-0576312d34fc service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:20.388379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1066/2147] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:20.932955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bf56d-947f-46ee-bd9d-d93403140dfa None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:20.934562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-844bf56d-947f-46ee-bd9d-d93403140dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:20.962560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bf56d-947f-46ee-bd9d-d93403140dfa None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:20.978819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:20.979808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:20.980319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:20.980697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] PATH_INFO: `/v3/projects/b3b07ac7f0384fd185c55982f4983392` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:20.984410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b07ac7f0384fd185c55982f4983392)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:20.988706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:21.093258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b07ac7f0384fd185c55982f4983392', 'request_id': 'req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.116270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b07ac7f0384fd185c55982f4983392', 'request_id': 'req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.128703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b07ac7f0384fd185c55982f4983392', 'request_id': 'req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.142452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] The token cache is being invalidate because project b3b07ac7f0384fd185c55982f4983392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:21.143407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.144138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.145752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1082/2148] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:20 2022] DELETE /identity/v3/projects/b3b07ac7f0384fd185c55982f4983392 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:21.149830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ad039-2a57-4f97-855d-0576312d34fc service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:21.177280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ad039-2a57-4f97-855d-0576312d34fc service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:21.231430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:21.268336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:21.269566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:21.269851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:21.270122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] PATH_INFO: `/v3/users/eb19bc08153e4565865d54325e9c0007` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:21.271561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb19bc08153e4565865d54325e9c0007)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:21.273509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:21.334842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb19bc08153e4565865d54325e9c0007'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.335513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb19bc08153e4565865d54325e9c0007'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.357840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb19bc08153e4565865d54325e9c0007'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.368832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb19bc08153e4565865d54325e9c0007'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.395285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6ea9ed8c-c5ec-4678-81b7-33747bf1a78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb19bc08153e4565865d54325e9c0007'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.418092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1067/2149] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:21 2022] DELETE /identity/v3/users/eb19bc08153e4565865d54325e9c0007 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:21.768200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:21.769975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:21.786588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdd267-7dad-4eca-b4a1-d61c8b466c9f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:21.879987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:21.881299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:21.881299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:21.881686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] PATH_INFO: `/v3/projects/2ab2237daa8b40bda9e70a951d90cb4e` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:21.883157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab2237daa8b40bda9e70a951d90cb4e)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:21.885200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:21.921865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:21.952226 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab2237daa8b40bda9e70a951d90cb4e', 'request_id': 'req-28c2dd58-7a98-43fe-851d-13ac65675dd6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.961540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab2237daa8b40bda9e70a951d90cb4e', 'request_id': 'req-28c2dd58-7a98-43fe-851d-13ac65675dd6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.970795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab2237daa8b40bda9e70a951d90cb4e', 'request_id': 'req-28c2dd58-7a98-43fe-851d-13ac65675dd6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.991461 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] The token cache is being invalidate because project 2ab2237daa8b40bda9e70a951d90cb4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:21.991926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.992819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-28c2dd58-7a98-43fe-851d-13ac65675dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:21.994765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1083/2150] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:21 2022] DELETE /identity/v3/projects/2ab2237daa8b40bda9e70a951d90cb4e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:21.999480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2788c-66ec-437b-affa-4f72e761faee None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:21.999797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2788c-66ec-437b-affa-4f72e761faee None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:22.000093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2788c-66ec-437b-affa-4f72e761faee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:22.040953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-14f2788c-66ec-437b-affa-4f72e761faee None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:22.045034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-14f2788c-66ec-437b-affa-4f72e761faee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:22.150287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1068/2151] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:22.157836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba80aa-c8a5-4fb7-9fdc-f2b25528e4f7 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:22.159021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba80aa-c8a5-4fb7-9fdc-f2b25528e4f7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:22.159281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba80aa-c8a5-4fb7-9fdc-f2b25528e4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:22.197030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8cba80aa-c8a5-4fb7-9fdc-f2b25528e4f7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:22.200661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8cba80aa-c8a5-4fb7-9fdc-f2b25528e4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:22.229589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1084/2152] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:22.233560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2788c-66ec-437b-affa-4f72e761faee None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:22.256079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2788c-66ec-437b-affa-4f72e761faee None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:22.269847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d362f97-0399-49d5-9f84-669c9f4e83cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:22.274952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d362f97-0399-49d5-9f84-669c9f4e83cd admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:22.275586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d362f97-0399-49d5-9f84-669c9f4e83cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:22.276026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d362f97-0399-49d5-9f84-669c9f4e83cd admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:22.277117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d362f97-0399-49d5-9f84-669c9f4e83cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:22.277769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d362f97-0399-49d5-9f84-669c9f4e83cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:22.280663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d362f97-0399-49d5-9f84-669c9f4e83cd admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:22.303384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1069/2153] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:52:22.307671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba80aa-c8a5-4fb7-9fdc-f2b25528e4f7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:22.349945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba80aa-c8a5-4fb7-9fdc-f2b25528e4f7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:22.371050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63fc32-0fe0-4943-ab2e-66ffb88e3f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:22.371847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63fc32-0fe0-4943-ab2e-66ffb88e3f03 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:22.374077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63fc32-0fe0-4943-ab2e-66ffb88e3f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:22.374479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63fc32-0fe0-4943-ab2e-66ffb88e3f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:22.375300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63fc32-0fe0-4943-ab2e-66ffb88e3f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:22.388186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63fc32-0fe0-4943-ab2e-66ffb88e3f03 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:22.439100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1085/2154] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:22 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:22.445744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d362f97-0399-49d5-9f84-669c9f4e83cd admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:22.458246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d362f97-0399-49d5-9f84-669c9f4e83cd admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:22.534253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:22.568133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e5a8f-baf0-4240-855c-c7ff6c79eecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:22.569264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e5a8f-baf0-4240-855c-c7ff6c79eecc admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:22.569693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e5a8f-baf0-4240-855c-c7ff6c79eecc admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:22.570257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e5a8f-baf0-4240-855c-c7ff6c79eecc admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:22.572695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e5a8f-baf0-4240-855c-c7ff6c79eecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:22.575704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e5a8f-baf0-4240-855c-c7ff6c79eecc admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:22.609497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1070/2155] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:22 2022] POST /identity/v3/users => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:22.613886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63fc32-0fe0-4943-ab2e-66ffb88e3f03 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:22.629708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63fc32-0fe0-4943-ab2e-66ffb88e3f03 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:22.635681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd89ac-87a1-43ee-bab9-c08ee6b9a300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:22.637076 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd89ac-87a1-43ee-bab9-c08ee6b9a300 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:22.637464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd89ac-87a1-43ee-bab9-c08ee6b9a300 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:22.638270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd89ac-87a1-43ee-bab9-c08ee6b9a300 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:22.638722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd89ac-87a1-43ee-bab9-c08ee6b9a300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:22.640800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd89ac-87a1-43ee-bab9-c08ee6b9a300 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:22.660642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1086/2156] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:22.664639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e5a8f-baf0-4240-855c-c7ff6c79eecc admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:22.680398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e5a8f-baf0-4240-855c-c7ff6c79eecc admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:22.698603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09597a6-107f-47c2-8af5-9fe6ef83c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:22.700354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09597a6-107f-47c2-8af5-9fe6ef83c856 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:22.700764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09597a6-107f-47c2-8af5-9fe6ef83c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:22.701366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09597a6-107f-47c2-8af5-9fe6ef83c856 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:22.707876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09597a6-107f-47c2-8af5-9fe6ef83c856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:22.711700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09597a6-107f-47c2-8af5-9fe6ef83c856 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:22.731864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1071/2157] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:52:22.733092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd89ac-87a1-43ee-bab9-c08ee6b9a300 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:22.751837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd89ac-87a1-43ee-bab9-c08ee6b9a300 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:22.768612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b992c-6e2e-4ca6-b664-473615b7fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:22.769966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b992c-6e2e-4ca6-b664-473615b7fcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:22.770378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b992c-6e2e-4ca6-b664-473615b7fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:22.770667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b992c-6e2e-4ca6-b664-473615b7fcd3 admin admin] PATH_INFO: `/v3/projects/2299e16b05544705963d81c7188704cb/users/8291e8492760469ca608af8e4b1f5248/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:22.797800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b992c-6e2e-4ca6-b664-473615b7fcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2299e16b05544705963d81c7188704cb, user_id=8291e8492760469ca608af8e4b1f5248, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:22.802737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b992c-6e2e-4ca6-b664-473615b7fcd3 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:22.850295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1087/2158] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:22 2022] PUT /identity/v3/projects/2299e16b05544705963d81c7188704cb/users/8291e8492760469ca608af8e4b1f5248/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:22.855180 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57882d2-9419-4f0c-9961-02e760f56270 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:22.855470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57882d2-9419-4f0c-9961-02e760f56270 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:22.855754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57882d2-9419-4f0c-9961-02e760f56270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:22.881976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a57882d2-9419-4f0c-9961-02e760f56270 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:22.883059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a57882d2-9419-4f0c-9961-02e760f56270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:23.061379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1072/2159] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:23.070889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b992c-6e2e-4ca6-b664-473615b7fcd3 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:23.072983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-fe8b992c-6e2e-4ca6-b664-473615b7fcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:23.182715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b992c-6e2e-4ca6-b664-473615b7fcd3 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:23.187295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592d91c-f162-4baf-87c4-49bef02c56ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:23.188256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592d91c-f162-4baf-87c4-49bef02c56ee service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:23.188937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592d91c-f162-4baf-87c4-49bef02c56ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:23.190403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592d91c-f162-4baf-87c4-49bef02c56ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:23.208334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592d91c-f162-4baf-87c4-49bef02c56ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:23.210762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592d91c-f162-4baf-87c4-49bef02c56ee service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:23.245850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1088/2160] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:24.596845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe30c-877f-4094-a814-36622aeb19a3 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:24.597360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe30c-877f-4094-a814-36622aeb19a3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:24.597597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efe30c-877f-4094-a814-36622aeb19a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:24.640913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-40efe30c-877f-4094-a814-36622aeb19a3 None None] MFA Rules not processed for user `8291e8492760469ca608af8e4b1f5248`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:24.642276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-40efe30c-877f-4094-a814-36622aeb19a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:24.743715 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1073/2161] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:24.744926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592d91c-f162-4baf-87c4-49bef02c56ee service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:24.756263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592d91c-f162-4baf-87c4-49bef02c56ee service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:24.761636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7306b-43a1-4208-98af-d8b7ba674bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:24.762646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7306b-43a1-4208-98af-d8b7ba674bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:24.763169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7306b-43a1-4208-98af-d8b7ba674bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:24.763678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7306b-43a1-4208-98af-d8b7ba674bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:24.764491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7306b-43a1-4208-98af-d8b7ba674bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:24.766756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7306b-43a1-4208-98af-d8b7ba674bc9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:24.807332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1089/2162] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:24 2022] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:24.809132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe30c-877f-4094-a814-36622aeb19a3 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:24.823730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efe30c-877f-4094-a814-36622aeb19a3 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:24.894503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:24.906092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e20a6-be54-427c-8b17-6f6c08b35f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:24.907317 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e20a6-be54-427c-8b17-6f6c08b35f75 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:24.907742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e20a6-be54-427c-8b17-6f6c08b35f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:24.908128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e20a6-be54-427c-8b17-6f6c08b35f75 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:24.908929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e20a6-be54-427c-8b17-6f6c08b35f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:24.911879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e20a6-be54-427c-8b17-6f6c08b35f75 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:24.948752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1074/2163] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:24 2022] POST /identity/v3/users => generated 308 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:24.951050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7306b-43a1-4208-98af-d8b7ba674bc9 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:24.970420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7306b-43a1-4208-98af-d8b7ba674bc9 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:24.976170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22baaec-5d71-4618-a0e9-687df15467b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:24.977230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22baaec-5d71-4618-a0e9-687df15467b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:24.977686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22baaec-5d71-4618-a0e9-687df15467b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:24.978111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22baaec-5d71-4618-a0e9-687df15467b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:24.979074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22baaec-5d71-4618-a0e9-687df15467b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:24.981225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22baaec-5d71-4618-a0e9-687df15467b5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:25.001989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e20a6-be54-427c-8b17-6f6c08b35f75 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:25.009578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1090/2164] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:52:25.021496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e20a6-be54-427c-8b17-6f6c08b35f75 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:25.030417 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8251c6-9e1c-4cce-afe3-3233a8325414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:25.031296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8251c6-9e1c-4cce-afe3-3233a8325414 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:25.031296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8251c6-9e1c-4cce-afe3-3233a8325414 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:25.031595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8251c6-9e1c-4cce-afe3-3233a8325414 admin admin] PATH_INFO: `/v3/projects/8a2182536f904235a10fc7660a53a261/users/62153adefe4348b6a87639724476d2ab/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:25.054662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8251c6-9e1c-4cce-afe3-3233a8325414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2182536f904235a10fc7660a53a261, user_id=62153adefe4348b6a87639724476d2ab, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:25.058194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8251c6-9e1c-4cce-afe3-3233a8325414 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:25.082160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1075/2165] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:25 2022] PUT /identity/v3/projects/8a2182536f904235a10fc7660a53a261/users/62153adefe4348b6a87639724476d2ab/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:25.086468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22baaec-5d71-4618-a0e9-687df15467b5 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:25.095386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604661d-1558-47da-8107-1a34132df7cb None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:25.096215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604661d-1558-47da-8107-1a34132df7cb None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:25.097808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604661d-1558-47da-8107-1a34132df7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:25.101449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22baaec-5d71-4618-a0e9-687df15467b5 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:25.133587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:25.146255 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-1604661d-1558-47da-8107-1a34132df7cb None None] MFA Rules not processed for user `bdb094c631b44105b27b6a6e43a1330d`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:25.147688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1604661d-1558-47da-8107-1a34132df7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:25.223576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd9618-d72c-4691-8c64-2c48364c80e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:25.224786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd9618-d72c-4691-8c64-2c48364c80e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:25.225155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd9618-d72c-4691-8c64-2c48364c80e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:25.225442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd9618-d72c-4691-8c64-2c48364c80e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:25.227082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd9618-d72c-4691-8c64-2c48364c80e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:25.229487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd9618-d72c-4691-8c64-2c48364c80e7 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:25.242711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1091/2166] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:25.248371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd9618-d72c-4691-8c64-2c48364c80e7 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:25.256187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1076/2167] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:25.262525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd9618-d72c-4691-8c64-2c48364c80e7 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:25.269475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18526491-86b2-4e66-bcd8-cc7f5567b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:25.270834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18526491-86b2-4e66-bcd8-cc7f5567b243 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:25.271311 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18526491-86b2-4e66-bcd8-cc7f5567b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:25.271694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18526491-86b2-4e66-bcd8-cc7f5567b243 admin admin] PATH_INFO: `/v3/projects/8a2182536f904235a10fc7660a53a261/users/62153adefe4348b6a87639724476d2ab/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:25.274042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604661d-1558-47da-8107-1a34132df7cb None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:25.274440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18526491-86b2-4e66-bcd8-cc7f5567b243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2182536f904235a10fc7660a53a261, user_id=62153adefe4348b6a87639724476d2ab, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:25.275505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1604661d-1558-47da-8107-1a34132df7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:25.277612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18526491-86b2-4e66-bcd8-cc7f5567b243 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:25.296710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1092/2168] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:25 2022] PUT /identity/v3/projects/8a2182536f904235a10fc7660a53a261/users/62153adefe4348b6a87639724476d2ab/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:25.407498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604661d-1558-47da-8107-1a34132df7cb None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:25.477477 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:25.489384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a1696d1cc14ca6ac1cb970598f11fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:25.490105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:25.490440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:25.490718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:25.493448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:25.651554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:25.653285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:25.668883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1077/2169] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:25.915889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5676b-9609-45e4-9bb7-0ec96b12fa85 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:25.916384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5676b-9609-45e4-9bb7-0ec96b12fa85 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:25.916571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5676b-9609-45e4-9bb7-0ec96b12fa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:25.945747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-93d5676b-9609-45e4-9bb7-0ec96b12fa85 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:25.947089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-93d5676b-9609-45e4-9bb7-0ec96b12fa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:26.070848 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1093/2170] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:52:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:26.163358 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:26.165025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:26.307337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5676b-9609-45e4-9bb7-0ec96b12fa85 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:26.309263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-93d5676b-9609-45e4-9bb7-0ec96b12fa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:26.351930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cb307-c714-40fc-9dfc-e0a0ce8b8246 service glance] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:26.362849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118408eb-35e1-4249-8635-f335059df171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:26.364244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118408eb-35e1-4249-8635-f335059df171 service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:26.365731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118408eb-35e1-4249-8635-f335059df171 service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:26.366225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118408eb-35e1-4249-8635-f335059df171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:26.395523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118408eb-35e1-4249-8635-f335059df171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:26.398106 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118408eb-35e1-4249-8635-f335059df171 service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:26.424560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1078/2171] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:52:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:52:26.593515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5676b-9609-45e4-9bb7-0ec96b12fa85 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:26.601154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:26.602429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:26.602914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:26.603999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] PATH_INFO: `/v3/users/b3f2e2c8f5a243c9ad2b17fd2141927e` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:26.607846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f2e2c8f5a243c9ad2b17fd2141927e)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:26.610077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:26.619615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:26.711599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f2e2c8f5a243c9ad2b17fd2141927e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:26.719865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f2e2c8f5a243c9ad2b17fd2141927e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:26.722673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f2e2c8f5a243c9ad2b17fd2141927e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:26.757322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f2e2c8f5a243c9ad2b17fd2141927e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:26.766059 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e4a2b201-59a1-42b5-a8e2-39f44c923a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f2e2c8f5a243c9ad2b17fd2141927e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:26.807863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1094/2172] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:26 2022] DELETE /identity/v3/users/b3f2e2c8f5a243c9ad2b17fd2141927e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:26.812230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29372335-29c0-4660-867a-32bcd2f73408 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:26.812813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29372335-29c0-4660-867a-32bcd2f73408 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:26.812908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29372335-29c0-4660-867a-32bcd2f73408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:26.917578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-29372335-29c0-4660-867a-32bcd2f73408 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:26.921325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-29372335-29c0-4660-867a-32bcd2f73408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:27.090074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:27.122743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471bc68-d06b-40af-8042-ca6a6478846d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:27.123419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471bc68-d06b-40af-8042-ca6a6478846d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:27.123870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471bc68-d06b-40af-8042-ca6a6478846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:27.131732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1079/2173] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:27.147874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29372335-29c0-4660-867a-32bcd2f73408 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:27.151806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-29372335-29c0-4660-867a-32bcd2f73408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:27.221482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0471bc68-d06b-40af-8042-ca6a6478846d None None] MFA Rules not processed for user `62153adefe4348b6a87639724476d2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:27.223075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0471bc68-d06b-40af-8042-ca6a6478846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:27.373901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29372335-29c0-4660-867a-32bcd2f73408 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:27.389995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1fb66-b896-4eae-984a-e1b5669e00f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:27.390809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1fb66-b896-4eae-984a-e1b5669e00f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:27.393216 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1fb66-b896-4eae-984a-e1b5669e00f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:27.393591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1fb66-b896-4eae-984a-e1b5669e00f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:27.406943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1095/2174] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:27.408674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471bc68-d06b-40af-8042-ca6a6478846d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:27.411941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1fb66-b896-4eae-984a-e1b5669e00f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:27.413823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1fb66-b896-4eae-984a-e1b5669e00f9 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:27.429970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0471bc68-d06b-40af-8042-ca6a6478846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:27.432059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1080/2175] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:27.456826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471bc68-d06b-40af-8042-ca6a6478846d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:27.468367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:27.469359 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:27.469706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:27.470049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] PATH_INFO: `/v3/users/8f49c9c046b74a489e6a91c522e2cbc4` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:27.476577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f49c9c046b74a489e6a91c522e2cbc4)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:27.478707 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:27.610814 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f49c9c046b74a489e6a91c522e2cbc4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:27.614778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f49c9c046b74a489e6a91c522e2cbc4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:27.615965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f49c9c046b74a489e6a91c522e2cbc4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:27.628114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:27.634388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f49c9c046b74a489e6a91c522e2cbc4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:27.655194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f49c9c046b74a489e6a91c522e2cbc4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:27.687495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1096/2176] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:27 2022] DELETE /identity/v3/users/8f49c9c046b74a489e6a91c522e2cbc4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:27.692282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d22452-c2fc-4741-b1ee-3e09c4d5764d None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:27.692865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d22452-c2fc-4741-b1ee-3e09c4d5764d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:27.693211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d22452-c2fc-4741-b1ee-3e09c4d5764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:27.745770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b0d22452-c2fc-4741-b1ee-3e09c4d5764d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:27.747412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b0d22452-c2fc-4741-b1ee-3e09c4d5764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:27.876764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1081/2177] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:27.888518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:27.890807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:27.995731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bdbe6-203e-447c-b8e7-58251af6e147 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:28.000150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cfe03-5f02-4edb-a3cb-617cc3bd8289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:28.001144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cfe03-5f02-4edb-a3cb-617cc3bd8289 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:28.001600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cfe03-5f02-4edb-a3cb-617cc3bd8289 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:28.003023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cfe03-5f02-4edb-a3cb-617cc3bd8289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:28.015911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cfe03-5f02-4edb-a3cb-617cc3bd8289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:28.017078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cfe03-5f02-4edb-a3cb-617cc3bd8289 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:28.055382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1097/2178] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:28.237194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d22452-c2fc-4741-b1ee-3e09c4d5764d None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:28.239292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b0d22452-c2fc-4741-b1ee-3e09c4d5764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:28.275854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d22452-c2fc-4741-b1ee-3e09c4d5764d None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:28.284957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:28.286142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:28.286544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:28.286972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] PATH_INFO: `/v3/projects/e50fab96359a4c0fa871582f6cc80c1f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:28.293304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50fab96359a4c0fa871582f6cc80c1f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:28.295394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:28.471094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50fab96359a4c0fa871582f6cc80c1f', 'request_id': 'req-6d1ac635-5f97-4133-a73a-b22de8d976d9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:28.497212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50fab96359a4c0fa871582f6cc80c1f', 'request_id': 'req-6d1ac635-5f97-4133-a73a-b22de8d976d9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:28.561798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50fab96359a4c0fa871582f6cc80c1f', 'request_id': 'req-6d1ac635-5f97-4133-a73a-b22de8d976d9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:28.579489 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:28.609604 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] The token cache is being invalidate because project e50fab96359a4c0fa871582f6cc80c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:28.610140 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:28.611861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d1ac635-5f97-4133-a73a-b22de8d976d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:28.616452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1082/2179] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:28 2022] DELETE /identity/v3/projects/e50fab96359a4c0fa871582f6cc80c1f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:29.066258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cfe03-5f02-4edb-a3cb-617cc3bd8289 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:29.068617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-fc8cfe03-5f02-4edb-a3cb-617cc3bd8289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:29.101376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cfe03-5f02-4edb-a3cb-617cc3bd8289 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:29.224741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:29.226173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.226930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.227617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] PATH_INFO: `/v3/projects/20a9e774e8f54917ae9bb767e27b1a74` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:29.229571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a9e774e8f54917ae9bb767e27b1a74)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:29.232263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:29.302248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a9e774e8f54917ae9bb767e27b1a74', 'request_id': 'req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:29.315595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a9e774e8f54917ae9bb767e27b1a74', 'request_id': 'req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:29.326569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a9e774e8f54917ae9bb767e27b1a74', 'request_id': 'req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:29.350964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] The token cache is being invalidate because project 20a9e774e8f54917ae9bb767e27b1a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:29.351688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:29.352571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-2b9719bd-07cb-4a17-b1a6-9fed87fbd775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:29.354928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1098/2180] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:29 2022] DELETE /identity/v3/projects/20a9e774e8f54917ae9bb767e27b1a74 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:29.360366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e5746-bc36-4e5b-b7a6-6e601742c5ac None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.361892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e5746-bc36-4e5b-b7a6-6e601742c5ac None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.363222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e5746-bc36-4e5b-b7a6-6e601742c5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:29.433345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-1c8e5746-bc36-4e5b-b7a6-6e601742c5ac None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:29.434967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1c8e5746-bc36-4e5b-b7a6-6e601742c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:29.531084 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1083/2181] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:29.532796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932884d-97e2-4f2c-bb2a-a0088e73c285 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.533903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932884d-97e2-4f2c-bb2a-a0088e73c285 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.534258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932884d-97e2-4f2c-bb2a-a0088e73c285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:29.559819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-b932884d-97e2-4f2c-bb2a-a0088e73c285 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:29.560979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b932884d-97e2-4f2c-bb2a-a0088e73c285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:29.570538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1099/2182] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:29.574810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e5746-bc36-4e5b-b7a6-6e601742c5ac None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:29.586299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e5746-bc36-4e5b-b7a6-6e601742c5ac None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:29.592842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74a539-ab0f-40f9-99d4-0bc2f929fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:29.594220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74a539-ab0f-40f9-99d4-0bc2f929fa07 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.594660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74a539-ab0f-40f9-99d4-0bc2f929fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.595071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74a539-ab0f-40f9-99d4-0bc2f929fa07 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:29.598725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74a539-ab0f-40f9-99d4-0bc2f929fa07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:29.598725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74a539-ab0f-40f9-99d4-0bc2f929fa07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:29.599345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74a539-ab0f-40f9-99d4-0bc2f929fa07 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:29.618933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1084/2183] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:52:29.620616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932884d-97e2-4f2c-bb2a-a0088e73c285 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:29.625612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:29.633519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932884d-97e2-4f2c-bb2a-a0088e73c285 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:29.643081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58308abd-0506-43ed-a8d3-c082d488f9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:29.644489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58308abd-0506-43ed-a8d3-c082d488f9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.645026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58308abd-0506-43ed-a8d3-c082d488f9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.645412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58308abd-0506-43ed-a8d3-c082d488f9a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:29.646368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58308abd-0506-43ed-a8d3-c082d488f9a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:29.649225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58308abd-0506-43ed-a8d3-c082d488f9a4 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:29.688008 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74a539-ab0f-40f9-99d4-0bc2f929fa07 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:29.688280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1100/2184] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:29 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:29.699438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74a539-ab0f-40f9-99d4-0bc2f929fa07 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:29.778722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62ff9e-3811-405a-a4bf-b7cf6b174d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:29.779609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62ff9e-3811-405a-a4bf-b7cf6b174d1f admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.780033 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62ff9e-3811-405a-a4bf-b7cf6b174d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.780422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62ff9e-3811-405a-a4bf-b7cf6b174d1f admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:29.781240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62ff9e-3811-405a-a4bf-b7cf6b174d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:29.784081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62ff9e-3811-405a-a4bf-b7cf6b174d1f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:29.819450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1085/2185] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:29 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:29.819885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58308abd-0506-43ed-a8d3-c082d488f9a4 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:29.837153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58308abd-0506-43ed-a8d3-c082d488f9a4 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:29.842601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e0226-446a-4d96-866f-848f7636364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:29.843549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0226-446a-4d96-866f-848f7636364f admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.843938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0226-446a-4d96-866f-848f7636364f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.844322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0226-446a-4d96-866f-848f7636364f admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:29.845171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e0226-446a-4d96-866f-848f7636364f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:29.847236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62ff9e-3811-405a-a4bf-b7cf6b174d1f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:29.849484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4a62ff9e-3811-405a-a4bf-b7cf6b174d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:29.860746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e0226-446a-4d96-866f-848f7636364f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:29.876398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62ff9e-3811-405a-a4bf-b7cf6b174d1f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:29.882949 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1101/2186] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:29.883349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:29.887603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e0226-446a-4d96-866f-848f7636364f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:29.891871 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.892471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.893218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] PATH_INFO: `/v3/users/8291e8492760469ca608af8e4b1f5248` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:29.895011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8291e8492760469ca608af8e4b1f5248)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:29.897792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:29.904362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e0226-446a-4d96-866f-848f7636364f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:29.922770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e374d-e02f-4629-8baf-a40a4e62ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:29.923632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e374d-e02f-4629-8baf-a40a4e62ef53 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.926897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e374d-e02f-4629-8baf-a40a4e62ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.927338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e374d-e02f-4629-8baf-a40a4e62ef53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:29.928210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e374d-e02f-4629-8baf-a40a4e62ef53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:29.929931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e374d-e02f-4629-8baf-a40a4e62ef53 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:29.951561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1102/2187] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:29.959590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e374d-e02f-4629-8baf-a40a4e62ef53 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:29.972816 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e374d-e02f-4629-8baf-a40a4e62ef53 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:29.992284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cfd6b-b023-4e89-bd5c-5d17a1118538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:29.993317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cfd6b-b023-4e89-bd5c-5d17a1118538 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:29.993712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cfd6b-b023-4e89-bd5c-5d17a1118538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:29.994108 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cfd6b-b023-4e89-bd5c-5d17a1118538 admin admin] PATH_INFO: `/v3/projects/29f12b7be4aa4e8cadc0d5d99b9a04e3/users/b5b94f1f0159495e91f99206c3d02da3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:30.022630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8291e8492760469ca608af8e4b1f5248'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.034439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8291e8492760469ca608af8e4b1f5248'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.038136 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cfd6b-b023-4e89-bd5c-5d17a1118538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f12b7be4aa4e8cadc0d5d99b9a04e3, user_id=b5b94f1f0159495e91f99206c3d02da3, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:30.040999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cfd6b-b023-4e89-bd5c-5d17a1118538 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:30.042761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:30.072176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1103/2188] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:29 2022] PUT /identity/v3/projects/29f12b7be4aa4e8cadc0d5d99b9a04e3/users/b5b94f1f0159495e91f99206c3d02da3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:30.085714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797969eb-e528-4bab-9d3f-f86254c09cb4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:30.086058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797969eb-e528-4bab-9d3f-f86254c09cb4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:30.086452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797969eb-e528-4bab-9d3f-f86254c09cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:30.094634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8291e8492760469ca608af8e4b1f5248'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.120900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-797969eb-e528-4bab-9d3f-f86254c09cb4 None None] MFA Rules not processed for user `b5b94f1f0159495e91f99206c3d02da3`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:30.121973 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8291e8492760469ca608af8e4b1f5248'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.122825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-797969eb-e528-4bab-9d3f-f86254c09cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:30.143811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8291e8492760469ca608af8e4b1f5248'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.152867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1086/2189] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:29 2022] DELETE /identity/v3/users/8291e8492760469ca608af8e4b1f5248 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:30.234898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1104/2190] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:30.250450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:30.252948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:30.343222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c004ddb-9945-45a9-971f-da71e40aace2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:30.348641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3152e38-dfd1-44a4-a425-1109ddff7f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:30.349937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152e38-dfd1-44a4-a425-1109ddff7f1b service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:30.350296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152e38-dfd1-44a4-a425-1109ddff7f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:30.350746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3152e38-dfd1-44a4-a425-1109ddff7f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:30.433987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3152e38-dfd1-44a4-a425-1109ddff7f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:30.436298 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3152e38-dfd1-44a4-a425-1109ddff7f1b service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:30.450869 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1087/2191] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:30.582639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797969eb-e528-4bab-9d3f-f86254c09cb4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:30.586507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-797969eb-e528-4bab-9d3f-f86254c09cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:30.685703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797969eb-e528-4bab-9d3f-f86254c09cb4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:30.722368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:30.764668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:30.766810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:30.767144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:30.768350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] PATH_INFO: `/v3/projects/2299e16b05544705963d81c7188704cb` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:30.770624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2299e16b05544705963d81c7188704cb)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:30.772789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:30.868510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2299e16b05544705963d81c7188704cb', 'request_id': 'req-cd746613-81aa-4b15-b9ad-3e6d3d7af600'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.900113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2299e16b05544705963d81c7188704cb', 'request_id': 'req-cd746613-81aa-4b15-b9ad-3e6d3d7af600'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.913521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2299e16b05544705963d81c7188704cb', 'request_id': 'req-cd746613-81aa-4b15-b9ad-3e6d3d7af600'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.925603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] The token cache is being invalidate because project 2299e16b05544705963d81c7188704cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:30.925878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.926653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:30.928764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1105/2192] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:30 2022] DELETE /identity/v3/projects/2299e16b05544705963d81c7188704cb => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:30.932890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3152e38-dfd1-44a4-a425-1109ddff7f1b service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:30.966038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3152e38-dfd1-44a4-a425-1109ddff7f1b service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:31.065214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:31.066929 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:31.067411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:31.068188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] PATH_INFO: `/v3/users/62153adefe4348b6a87639724476d2ab` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:31.070956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62153adefe4348b6a87639724476d2ab)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:31.074009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:31.152294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:31.193027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62153adefe4348b6a87639724476d2ab'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:31.194019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62153adefe4348b6a87639724476d2ab'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:31.229066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62153adefe4348b6a87639724476d2ab'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:31.244706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62153adefe4348b6a87639724476d2ab'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:31.256904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ee24e651-57a7-46bc-b70b-521324728ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62153adefe4348b6a87639724476d2ab'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:31.263761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1088/2193] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:30 2022] DELETE /identity/v3/users/62153adefe4348b6a87639724476d2ab => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:32.028777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:32.031270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:32.072602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd746613-81aa-4b15-b9ad-3e6d3d7af600 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:32.151765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:32.152652 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.152937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.153218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] PATH_INFO: `/v3/projects/8a2182536f904235a10fc7660a53a261` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:32.154800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2182536f904235a10fc7660a53a261)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:32.156847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:32.250281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2182536f904235a10fc7660a53a261', 'request_id': 'req-fbd1fe7a-8c78-4703-a762-5576c773146a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:32.261118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2182536f904235a10fc7660a53a261', 'request_id': 'req-fbd1fe7a-8c78-4703-a762-5576c773146a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:32.271752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2182536f904235a10fc7660a53a261', 'request_id': 'req-fbd1fe7a-8c78-4703-a762-5576c773146a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:32.280608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:32.313674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] The token cache is being invalidate because project 8a2182536f904235a10fc7660a53a261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:32.314033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:32.315606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fbd1fe7a-8c78-4703-a762-5576c773146a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:32.317705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1106/2194] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:32 2022] DELETE /identity/v3/projects/8a2182536f904235a10fc7660a53a261 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:32.322411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb4f6f-9e8c-439d-bb7b-2b1257d43f88 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.322900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb4f6f-9e8c-439d-bb7b-2b1257d43f88 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.322900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb4f6f-9e8c-439d-bb7b-2b1257d43f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:32.357131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-9dfb4f6f-9e8c-439d-bb7b-2b1257d43f88 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:32.358603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9dfb4f6f-9e8c-439d-bb7b-2b1257d43f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:32.482535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1089/2195] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:32.484822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165334c6-8c39-40c6-916e-2319b8e85be6 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.485174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165334c6-8c39-40c6-916e-2319b8e85be6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.485562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165334c6-8c39-40c6-916e-2319b8e85be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:32.523547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-165334c6-8c39-40c6-916e-2319b8e85be6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:32.524940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-165334c6-8c39-40c6-916e-2319b8e85be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:32.539088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1107/2196] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:32.542946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb4f6f-9e8c-439d-bb7b-2b1257d43f88 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:32.560688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb4f6f-9e8c-439d-bb7b-2b1257d43f88 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:32.567055 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a74e3-8162-4c20-afcf-b9599a195f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:32.567959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a74e3-8162-4c20-afcf-b9599a195f3e admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.568242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a74e3-8162-4c20-afcf-b9599a195f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.568520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a74e3-8162-4c20-afcf-b9599a195f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:32.577849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a74e3-8162-4c20-afcf-b9599a195f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:32.578509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a74e3-8162-4c20-afcf-b9599a195f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:32.580591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a74e3-8162-4c20-afcf-b9599a195f3e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:32.600820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1090/2197] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:52:32.604906 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165334c6-8c39-40c6-916e-2319b8e85be6 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:32.619152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165334c6-8c39-40c6-916e-2319b8e85be6 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:32.626051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9887a-8f33-4f20-9978-bb8380e8ac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:32.627418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9887a-8f33-4f20-9978-bb8380e8ac44 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.627715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9887a-8f33-4f20-9978-bb8380e8ac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.628001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9887a-8f33-4f20-9978-bb8380e8ac44 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:32.628731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9887a-8f33-4f20-9978-bb8380e8ac44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:32.630937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9887a-8f33-4f20-9978-bb8380e8ac44 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:32.673003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1108/2198] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:32 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:32.677956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a74e3-8162-4c20-afcf-b9599a195f3e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:32.692801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a74e3-8162-4c20-afcf-b9599a195f3e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:32.780560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94396148-cac7-44b9-830c-ab8d126c30c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:32.781829 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94396148-cac7-44b9-830c-ab8d126c30c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.782207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94396148-cac7-44b9-830c-ab8d126c30c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.782764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94396148-cac7-44b9-830c-ab8d126c30c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:32.786031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94396148-cac7-44b9-830c-ab8d126c30c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:32.788069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94396148-cac7-44b9-830c-ab8d126c30c6 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:32.817662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1091/2199] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:32 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:32.821974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9887a-8f33-4f20-9978-bb8380e8ac44 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:32.836860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9887a-8f33-4f20-9978-bb8380e8ac44 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:32.841965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd105674-9edf-44e0-baff-1b78b1d97ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:32.842930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105674-9edf-44e0-baff-1b78b1d97ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.843283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105674-9edf-44e0-baff-1b78b1d97ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.843730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105674-9edf-44e0-baff-1b78b1d97ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:32.844951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd105674-9edf-44e0-baff-1b78b1d97ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:32.847682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd105674-9edf-44e0-baff-1b78b1d97ab7 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:32.863196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1109/2200] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:52:32.867250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94396148-cac7-44b9-830c-ab8d126c30c6 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:32.879771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94396148-cac7-44b9-830c-ab8d126c30c6 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:32.884725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3d03d-e5d7-4315-a595-eb3805c641fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:32.885498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3d03d-e5d7-4315-a595-eb3805c641fc admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.885881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3d03d-e5d7-4315-a595-eb3805c641fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.886412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3d03d-e5d7-4315-a595-eb3805c641fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:32.888291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3d03d-e5d7-4315-a595-eb3805c641fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:32.890002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3d03d-e5d7-4315-a595-eb3805c641fc admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:32.902529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1092/2201] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:32.906590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd105674-9edf-44e0-baff-1b78b1d97ab7 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:32.920305 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd105674-9edf-44e0-baff-1b78b1d97ab7 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:32.928242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeda11-3eed-4464-9b78-eef4c7508770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:32.929163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeda11-3eed-4464-9b78-eef4c7508770 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.929445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeda11-3eed-4464-9b78-eef4c7508770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.929726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeeda11-3eed-4464-9b78-eef4c7508770 admin admin] PATH_INFO: `/v3/projects/10cccbfd477e4df1a8e301ed84aa40af/users/ba0973988aec4d5bbc10ad97a450e3ee/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:32.956088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeeda11-3eed-4464-9b78-eef4c7508770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cccbfd477e4df1a8e301ed84aa40af, user_id=ba0973988aec4d5bbc10ad97a450e3ee, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:32.963102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeeda11-3eed-4464-9b78-eef4c7508770 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:32.983066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1110/2202] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:32 2022] PUT /identity/v3/projects/10cccbfd477e4df1a8e301ed84aa40af/users/ba0973988aec4d5bbc10ad97a450e3ee/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:32.997011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d9d8c-b6b0-4661-ac2f-356c4c32e792 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:32.997711 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d9d8c-b6b0-4661-ac2f-356c4c32e792 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:32.998002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d9d8c-b6b0-4661-ac2f-356c4c32e792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:33.020245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:33.049239 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f21d9d8c-b6b0-4661-ac2f-356c4c32e792 None None] MFA Rules not processed for user `ba0973988aec4d5bbc10ad97a450e3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:33.050964 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f21d9d8c-b6b0-4661-ac2f-356c4c32e792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:33.145121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1093/2203] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:33.150160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeda11-3eed-4464-9b78-eef4c7508770 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:33.242425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeeda11-3eed-4464-9b78-eef4c7508770 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:33.250141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fec4f9-2630-473d-8aee-55a1f4fccf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:33.251115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fec4f9-2630-473d-8aee-55a1f4fccf78 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:33.251524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fec4f9-2630-473d-8aee-55a1f4fccf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:33.252681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fec4f9-2630-473d-8aee-55a1f4fccf78 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:33.256816 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fec4f9-2630-473d-8aee-55a1f4fccf78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:33.258807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fec4f9-2630-473d-8aee-55a1f4fccf78 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:33.293777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1111/2204] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:33 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:33.297663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d9d8c-b6b0-4661-ac2f-356c4c32e792 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:33.310685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d9d8c-b6b0-4661-ac2f-356c4c32e792 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:33.381900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110c91a-7de9-4ec9-9b4c-453cdddc811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:33.382640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110c91a-7de9-4ec9-9b4c-453cdddc811c admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:33.382909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110c91a-7de9-4ec9-9b4c-453cdddc811c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:33.383220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110c91a-7de9-4ec9-9b4c-453cdddc811c admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:33.383918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110c91a-7de9-4ec9-9b4c-453cdddc811c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:33.385860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110c91a-7de9-4ec9-9b4c-453cdddc811c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:33.413017 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1094/2205] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:33 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:33.414134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fec4f9-2630-473d-8aee-55a1f4fccf78 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:33.427189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fec4f9-2630-473d-8aee-55a1f4fccf78 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:33.432341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf972e0-4f6b-419f-8e4e-efd835c65c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:33.433134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf972e0-4f6b-419f-8e4e-efd835c65c6c admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:33.433484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf972e0-4f6b-419f-8e4e-efd835c65c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:33.433830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf972e0-4f6b-419f-8e4e-efd835c65c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:33.434667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf972e0-4f6b-419f-8e4e-efd835c65c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:33.436405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf972e0-4f6b-419f-8e4e-efd835c65c6c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:33.451375 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1112/2206] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:52:33.456115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110c91a-7de9-4ec9-9b4c-453cdddc811c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:33.469613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110c91a-7de9-4ec9-9b4c-453cdddc811c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:33.475465 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd715140-4da4-47d0-85dd-37e9e524a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:33.476555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715140-4da4-47d0-85dd-37e9e524a73c admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:33.477037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715140-4da4-47d0-85dd-37e9e524a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:33.477463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715140-4da4-47d0-85dd-37e9e524a73c admin admin] PATH_INFO: `/v3/projects/4bd0239e1e9a497eb846cf416ea9db3f/users/ffe83d34d70a4ab2964e123c74e21819/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:33.497644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd715140-4da4-47d0-85dd-37e9e524a73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd0239e1e9a497eb846cf416ea9db3f, user_id=ffe83d34d70a4ab2964e123c74e21819, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:33.501032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd715140-4da4-47d0-85dd-37e9e524a73c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:33.520639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1095/2207] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:33 2022] PUT /identity/v3/projects/4bd0239e1e9a497eb846cf416ea9db3f/users/ffe83d34d70a4ab2964e123c74e21819/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:33.523712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf972e0-4f6b-419f-8e4e-efd835c65c6c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:33.539158 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf972e0-4f6b-419f-8e4e-efd835c65c6c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:33.612860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8156f-e611-4552-b899-94797b85148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:33.613690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8156f-e611-4552-b899-94797b85148b admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:33.614046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8156f-e611-4552-b899-94797b85148b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:33.614467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8156f-e611-4552-b899-94797b85148b admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:33.615511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8156f-e611-4552-b899-94797b85148b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:33.617259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8156f-e611-4552-b899-94797b85148b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:33.622916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:33.641009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1113/2208] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:33.641231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd715140-4da4-47d0-85dd-37e9e524a73c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:33.651371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd715140-4da4-47d0-85dd-37e9e524a73c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:33.656834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486964eb-c6c6-4bbe-8cbe-49da0fe5658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:33.659226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486964eb-c6c6-4bbe-8cbe-49da0fe5658a admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:33.659226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486964eb-c6c6-4bbe-8cbe-49da0fe5658a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:33.659226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486964eb-c6c6-4bbe-8cbe-49da0fe5658a admin admin] PATH_INFO: `/v3/projects/4bd0239e1e9a497eb846cf416ea9db3f/users/ffe83d34d70a4ab2964e123c74e21819/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:33.661196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486964eb-c6c6-4bbe-8cbe-49da0fe5658a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd0239e1e9a497eb846cf416ea9db3f, user_id=ffe83d34d70a4ab2964e123c74e21819, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:33.664205 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486964eb-c6c6-4bbe-8cbe-49da0fe5658a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:33.677660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1096/2209] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:33 2022] PUT /identity/v3/projects/4bd0239e1e9a497eb846cf416ea9db3f/users/ffe83d34d70a4ab2964e123c74e21819/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:33.687834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae97d27-9fbf-49bd-8dda-8e18d61f76e9 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:33.688135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae97d27-9fbf-49bd-8dda-8e18d61f76e9 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:33.688427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae97d27-9fbf-49bd-8dda-8e18d61f76e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:33.720387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-3ae97d27-9fbf-49bd-8dda-8e18d61f76e9 None None] MFA Rules not processed for user `ffe83d34d70a4ab2964e123c74e21819`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:33.722153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3ae97d27-9fbf-49bd-8dda-8e18d61f76e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:33.807513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1114/2210] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:33.820648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486964eb-c6c6-4bbe-8cbe-49da0fe5658a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:33.822420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-486964eb-c6c6-4bbe-8cbe-49da0fe5658a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:33.883735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:33.890137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486964eb-c6c6-4bbe-8cbe-49da0fe5658a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:33.896789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1a289-7970-4e3d-be40-a882ebfc079e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:33.897631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1a289-7970-4e3d-be40-a882ebfc079e service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:33.897981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1a289-7970-4e3d-be40-a882ebfc079e service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:33.898346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1a289-7970-4e3d-be40-a882ebfc079e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:33.911986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1a289-7970-4e3d-be40-a882ebfc079e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:33.913443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1a289-7970-4e3d-be40-a882ebfc079e service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:33.925935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1097/2211] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:34.002995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae97d27-9fbf-49bd-8dda-8e18d61f76e9 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:34.080477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae97d27-9fbf-49bd-8dda-8e18d61f76e9 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:34.087294 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:34.088181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:34.088468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:34.088754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] PATH_INFO: `/v3/users/ba0973988aec4d5bbc10ad97a450e3ee` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:34.090015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0973988aec4d5bbc10ad97a450e3ee)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:34.092396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:34.153624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0973988aec4d5bbc10ad97a450e3ee'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.154360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0973988aec4d5bbc10ad97a450e3ee'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.155613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0973988aec4d5bbc10ad97a450e3ee'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.176733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0973988aec4d5bbc10ad97a450e3ee'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.184661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0973988aec4d5bbc10ad97a450e3ee'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.203971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1115/2212] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:34 2022] DELETE /identity/v3/users/ba0973988aec4d5bbc10ad97a450e3ee => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:34.208616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e16f2-543e-4770-897d-7008909f5635 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:34.209194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e16f2-543e-4770-897d-7008909f5635 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:34.209807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e16f2-543e-4770-897d-7008909f5635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:34.235879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0f0e16f2-543e-4770-897d-7008909f5635 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:34.238086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0f0e16f2-543e-4770-897d-7008909f5635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:34.353391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1098/2213] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:34.370655 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:34.372181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:34.378204 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:34.453675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba601db8-5847-4da8-97a4-24744135a5c4 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:34.459138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c7e7-9236-4f42-a594-733c12e21fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:34.460021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c7e7-9236-4f42-a594-733c12e21fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:34.460511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c7e7-9236-4f42-a594-733c12e21fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:34.460963 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939c7e7-9236-4f42-a594-733c12e21fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:34.472742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939c7e7-9236-4f42-a594-733c12e21fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:34.474686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939c7e7-9236-4f42-a594-733c12e21fb5 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:34.490521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1116/2214] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:52:34.796042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e16f2-543e-4770-897d-7008909f5635 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:34.797750 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0f0e16f2-543e-4770-897d-7008909f5635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:34.818861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e16f2-543e-4770-897d-7008909f5635 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:34.832157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:34.833047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:34.833311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:34.833583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] PATH_INFO: `/v3/projects/10cccbfd477e4df1a8e301ed84aa40af` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:34.835732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cccbfd477e4df1a8e301ed84aa40af)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:34.838039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:34.897970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cccbfd477e4df1a8e301ed84aa40af', 'request_id': 'req-b7bd8bd5-801f-4606-91f2-af64fd5db608'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.910086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cccbfd477e4df1a8e301ed84aa40af', 'request_id': 'req-b7bd8bd5-801f-4606-91f2-af64fd5db608'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.918490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cccbfd477e4df1a8e301ed84aa40af', 'request_id': 'req-b7bd8bd5-801f-4606-91f2-af64fd5db608'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.931773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] The token cache is being invalidate because project 10cccbfd477e4df1a8e301ed84aa40af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:34.932060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.932713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:34.937022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1099/2215] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:34 2022] DELETE /identity/v3/projects/10cccbfd477e4df1a8e301ed84aa40af => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:34.938458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c7e7-9236-4f42-a594-733c12e21fb5 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:34.951714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939c7e7-9236-4f42-a594-733c12e21fb5 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:35.022888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:35.023948 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:35.024395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:35.024824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] PATH_INFO: `/v3/users/ffe83d34d70a4ab2964e123c74e21819` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:35.026029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe83d34d70a4ab2964e123c74e21819)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:35.027998 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:35.103845 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe83d34d70a4ab2964e123c74e21819'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.118561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe83d34d70a4ab2964e123c74e21819'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.119119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe83d34d70a4ab2964e123c74e21819'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.141354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe83d34d70a4ab2964e123c74e21819'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.150986 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ddb1ad6c-6d9c-409d-a132-f3763a32814e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe83d34d70a4ab2964e123c74e21819'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.169039 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1117/2216] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:34 2022] DELETE /identity/v3/users/ffe83d34d70a4ab2964e123c74e21819 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:35.669356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:35.670855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:35.701192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd8bd5-801f-4606-91f2-af64fd5db608 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:35.842484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:35.843549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:35.843719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:35.844139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] PATH_INFO: `/v3/projects/4bd0239e1e9a497eb846cf416ea9db3f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:35.848134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd0239e1e9a497eb846cf416ea9db3f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:35.853279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:35.900467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:35.950197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd0239e1e9a497eb846cf416ea9db3f', 'request_id': 'req-e3bcbe71-f061-4839-8852-1dbc05353640'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.960314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd0239e1e9a497eb846cf416ea9db3f', 'request_id': 'req-e3bcbe71-f061-4839-8852-1dbc05353640'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.976156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd0239e1e9a497eb846cf416ea9db3f', 'request_id': 'req-e3bcbe71-f061-4839-8852-1dbc05353640'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.993275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] The token cache is being invalidate because project 4bd0239e1e9a497eb846cf416ea9db3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:35.993724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.995072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3bcbe71-f061-4839-8852-1dbc05353640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:35.998222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1100/2217] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:35 2022] DELETE /identity/v3/projects/4bd0239e1e9a497eb846cf416ea9db3f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:36.003641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f9d7-9d57-40a9-8c9d-94974a0f2b60 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.003934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f9d7-9d57-40a9-8c9d-94974a0f2b60 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.004314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f9d7-9d57-40a9-8c9d-94974a0f2b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.029542 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-f236f9d7-9d57-40a9-8c9d-94974a0f2b60 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:36.031473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f236f9d7-9d57-40a9-8c9d-94974a0f2b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:36.056907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:36.125558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1118/2218] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:36.128117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0790b9-1b1b-4e43-a99d-ca0f55ce41f9 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.131088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0790b9-1b1b-4e43-a99d-ca0f55ce41f9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.131088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0790b9-1b1b-4e43-a99d-ca0f55ce41f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.155770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-cf0790b9-1b1b-4e43-a99d-ca0f55ce41f9 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:36.158989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-cf0790b9-1b1b-4e43-a99d-ca0f55ce41f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:36.174090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1101/2219] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:36.178424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f9d7-9d57-40a9-8c9d-94974a0f2b60 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:36.199445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f9d7-9d57-40a9-8c9d-94974a0f2b60 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:36.206726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f04eb-bf4b-4da3-9d97-e19619680daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:36.207438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f04eb-bf4b-4da3-9d97-e19619680daa admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.207732 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f04eb-bf4b-4da3-9d97-e19619680daa admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.208016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f04eb-bf4b-4da3-9d97-e19619680daa admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.209143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f04eb-bf4b-4da3-9d97-e19619680daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:36.209594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f04eb-bf4b-4da3-9d97-e19619680daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:36.212163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f04eb-bf4b-4da3-9d97-e19619680daa admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:36.232692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1119/2220] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:52:36.233875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0790b9-1b1b-4e43-a99d-ca0f55ce41f9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:36.247710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0790b9-1b1b-4e43-a99d-ca0f55ce41f9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:36.257690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198708-8101-49ab-a25b-07c952910d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:36.258648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198708-8101-49ab-a25b-07c952910d9a admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.259130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198708-8101-49ab-a25b-07c952910d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.259562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7198708-8101-49ab-a25b-07c952910d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.260573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7198708-8101-49ab-a25b-07c952910d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:36.263316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7198708-8101-49ab-a25b-07c952910d9a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:36.310367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1102/2221] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:36 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:36.313243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f04eb-bf4b-4da3-9d97-e19619680daa admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:36.335354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f04eb-bf4b-4da3-9d97-e19619680daa admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:36.404074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32282d4-20f3-42af-b9ff-f5f56bfb6088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:36.404815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32282d4-20f3-42af-b9ff-f5f56bfb6088 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.405319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32282d4-20f3-42af-b9ff-f5f56bfb6088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.405612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32282d4-20f3-42af-b9ff-f5f56bfb6088 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.406362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32282d4-20f3-42af-b9ff-f5f56bfb6088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:36.408350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32282d4-20f3-42af-b9ff-f5f56bfb6088 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:36.435177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1120/2222] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:36 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:36.436419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198708-8101-49ab-a25b-07c952910d9a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:36.452725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7198708-8101-49ab-a25b-07c952910d9a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:36.460204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbc42f-653a-4989-b12a-512213a6d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:36.461025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbc42f-653a-4989-b12a-512213a6d116 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.461781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbc42f-653a-4989-b12a-512213a6d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.462160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbc42f-653a-4989-b12a-512213a6d116 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.463296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbc42f-653a-4989-b12a-512213a6d116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:36.465032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbc42f-653a-4989-b12a-512213a6d116 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:36.481278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1103/2223] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:36.488125 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32282d4-20f3-42af-b9ff-f5f56bfb6088 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:36.498005 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32282d4-20f3-42af-b9ff-f5f56bfb6088 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:36.507181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ea380-31ce-412a-b675-2bb326c32cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:36.507739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ea380-31ce-412a-b675-2bb326c32cfe admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.508019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ea380-31ce-412a-b675-2bb326c32cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.508301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ea380-31ce-412a-b675-2bb326c32cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.509041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ea380-31ce-412a-b675-2bb326c32cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:36.510726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ea380-31ce-412a-b675-2bb326c32cfe admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:36.528868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1121/2224] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:36.533610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbc42f-653a-4989-b12a-512213a6d116 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:36.551064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbc42f-653a-4989-b12a-512213a6d116 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:36.556103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f0570-e87f-439e-bb07-fa53698b78c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:36.556996 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f0570-e87f-439e-bb07-fa53698b78c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.557282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f0570-e87f-439e-bb07-fa53698b78c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.557726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f0570-e87f-439e-bb07-fa53698b78c7 admin admin] PATH_INFO: `/v3/projects/04813df299c34613acc3d24245b11dbb/users/3af9daea21ac46459c81ea6952fa09bc/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.580208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f0570-e87f-439e-bb07-fa53698b78c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04813df299c34613acc3d24245b11dbb, user_id=3af9daea21ac46459c81ea6952fa09bc, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:36.583063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f0570-e87f-439e-bb07-fa53698b78c7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:36.602974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1104/2225] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:36 2022] PUT /identity/v3/projects/04813df299c34613acc3d24245b11dbb/users/3af9daea21ac46459c81ea6952fa09bc/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:36.611892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396973f-4414-4159-b6b6-d321a268f29c None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.612794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396973f-4414-4159-b6b6-d321a268f29c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.613289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396973f-4414-4159-b6b6-d321a268f29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.648043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-4396973f-4414-4159-b6b6-d321a268f29c None None] MFA Rules not processed for user `3af9daea21ac46459c81ea6952fa09bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:36.649676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4396973f-4414-4159-b6b6-d321a268f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:36.741763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1122/2226] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:36.753602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f0570-e87f-439e-bb07-fa53698b78c7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:36.757685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-977f0570-e87f-439e-bb07-fa53698b78c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:36.829181 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f0570-e87f-439e-bb07-fa53698b78c7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:36.835375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836a95-a7a9-4c50-a924-4d3ba797ba6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:36.836454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836a95-a7a9-4c50-a924-4d3ba797ba6c service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.836797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836a95-a7a9-4c50-a924-4d3ba797ba6c service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.837152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836a95-a7a9-4c50-a924-4d3ba797ba6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.848876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836a95-a7a9-4c50-a924-4d3ba797ba6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:36.850452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836a95-a7a9-4c50-a924-4d3ba797ba6c service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:36.863257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1105/2227] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:36.883550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396973f-4414-4159-b6b6-d321a268f29c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:36.908554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:36.978044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396973f-4414-4159-b6b6-d321a268f29c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:36.985436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:36.987012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:36.987458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:36.988277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] PATH_INFO: `/v3/users/3af9daea21ac46459c81ea6952fa09bc` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:36.989152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af9daea21ac46459c81ea6952fa09bc)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:36.991330 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:37.071848 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af9daea21ac46459c81ea6952fa09bc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.072875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af9daea21ac46459c81ea6952fa09bc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.074145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af9daea21ac46459c81ea6952fa09bc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.104587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af9daea21ac46459c81ea6952fa09bc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.114943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af9daea21ac46459c81ea6952fa09bc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.134110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ef336-f1c9-48c4-86c5-9cac1d7991e8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:37.134372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1123/2228] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:36 2022] DELETE /identity/v3/users/3af9daea21ac46459c81ea6952fa09bc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:37.134509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ef336-f1c9-48c4-86c5-9cac1d7991e8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:37.134796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ef336-f1c9-48c4-86c5-9cac1d7991e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:37.153027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-281ef336-f1c9-48c4-86c5-9cac1d7991e8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:37.154264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-281ef336-f1c9-48c4-86c5-9cac1d7991e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:37.212164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:37.237985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1106/2229] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:37.248169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:37.249766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:37.315712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b94a4-4065-4b35-82cb-28d59973aff0 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:37.320448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3251f7-fc6d-4b93-947b-f7045d6da438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:37.321043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3251f7-fc6d-4b93-947b-f7045d6da438 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:37.321392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3251f7-fc6d-4b93-947b-f7045d6da438 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:37.321736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3251f7-fc6d-4b93-947b-f7045d6da438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:37.335201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3251f7-fc6d-4b93-947b-f7045d6da438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:37.336482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3251f7-fc6d-4b93-947b-f7045d6da438 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:37.348488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1124/2230] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:37.354115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ef336-f1c9-48c4-86c5-9cac1d7991e8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:37.358085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-281ef336-f1c9-48c4-86c5-9cac1d7991e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:37.380379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ef336-f1c9-48c4-86c5-9cac1d7991e8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:37.397531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:37.398630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:37.398921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:37.399407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] PATH_INFO: `/v3/users/b5b94f1f0159495e91f99206c3d02da3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:37.411972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b94f1f0159495e91f99206c3d02da3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:37.413939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:37.491644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b94f1f0159495e91f99206c3d02da3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.492384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b94f1f0159495e91f99206c3d02da3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.517782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b94f1f0159495e91f99206c3d02da3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.533531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b94f1f0159495e91f99206c3d02da3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.556080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b94f1f0159495e91f99206c3d02da3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.568508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1107/2231] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:37 2022] DELETE /identity/v3/users/b5b94f1f0159495e91f99206c3d02da3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:37.572643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bcc75-e32a-48d4-a833-5567f4e3657b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:37.572940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bcc75-e32a-48d4-a833-5567f4e3657b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:37.573223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bcc75-e32a-48d4-a833-5567f4e3657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:37.593835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-9e9bcc75-e32a-48d4-a833-5567f4e3657b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:37.595448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9e9bcc75-e32a-48d4-a833-5567f4e3657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:37.643199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:37.676498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1125/2232] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:37.687323 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:37.689014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:37.710072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bcc75-e32a-48d4-a833-5567f4e3657b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:37.711265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9e9bcc75-e32a-48d4-a833-5567f4e3657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:37.724705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bcc75-e32a-48d4-a833-5567f4e3657b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:37.729820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:37.730795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:37.731039 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:37.731795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] PATH_INFO: `/v3/projects/04813df299c34613acc3d24245b11dbb` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:37.732896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04813df299c34613acc3d24245b11dbb)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:37.745250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:37.799678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbae028-6e65-410a-9e93-ad42380c2b5e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:37.804402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a9088-0556-4f66-b34e-2339ecf5235b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:37.805348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a9088-0556-4f66-b34e-2339ecf5235b service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:37.805807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a9088-0556-4f66-b34e-2339ecf5235b service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:37.806256 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a9088-0556-4f66-b34e-2339ecf5235b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:37.822584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a9088-0556-4f66-b34e-2339ecf5235b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:37.824599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a9088-0556-4f66-b34e-2339ecf5235b service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:37.827579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04813df299c34613acc3d24245b11dbb', 'request_id': 'req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.839789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1108/2233] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:52:37.842510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04813df299c34613acc3d24245b11dbb', 'request_id': 'req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.854648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04813df299c34613acc3d24245b11dbb', 'request_id': 'req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.877282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] The token cache is being invalidate because project 04813df299c34613acc3d24245b11dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:37.878193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.879796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8a126e84-1ab5-4ea3-9b33-8a2d0d14af16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:37.888017 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ff102-4a9e-4c1e-a2fd-0f757300da91 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:37.888515 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ff102-4a9e-4c1e-a2fd-0f757300da91 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:37.888692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ff102-4a9e-4c1e-a2fd-0f757300da91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:37.890119 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1126/2234] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:37 2022] DELETE /identity/v3/projects/04813df299c34613acc3d24245b11dbb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:37.916218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-737ff102-4a9e-4c1e-a2fd-0f757300da91 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:37.918143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-737ff102-4a9e-4c1e-a2fd-0f757300da91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:37.996870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:38.032840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1109/2235] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:38.043264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21a8d-5e14-413b-8565-a9bac1877835 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.043642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21a8d-5e14-413b-8565-a9bac1877835 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.043854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21a8d-5e14-413b-8565-a9bac1877835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.076051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-54b21a8d-5e14-413b-8565-a9bac1877835 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:38.077903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-54b21a8d-5e14-413b-8565-a9bac1877835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:38.090376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1127/2236] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:38.093742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ff102-4a9e-4c1e-a2fd-0f757300da91 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.107806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ff102-4a9e-4c1e-a2fd-0f757300da91 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.115888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488255b7-a457-4be1-9d00-83cc42c072df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.116977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488255b7-a457-4be1-9d00-83cc42c072df admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.117490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488255b7-a457-4be1-9d00-83cc42c072df admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.117961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488255b7-a457-4be1-9d00-83cc42c072df admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.119462 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488255b7-a457-4be1-9d00-83cc42c072df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:38.120119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488255b7-a457-4be1-9d00-83cc42c072df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.122002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488255b7-a457-4be1-9d00-83cc42c072df admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.143846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b21a8d-5e14-413b-8565-a9bac1877835 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.150722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1110/2237] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:52:38.155094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b21a8d-5e14-413b-8565-a9bac1877835 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.163173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cfb16-a534-4b59-beda-d2850ed932d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.163173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cfb16-a534-4b59-beda-d2850ed932d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.163173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cfb16-a534-4b59-beda-d2850ed932d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.163173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cfb16-a534-4b59-beda-d2850ed932d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.163764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cfb16-a534-4b59-beda-d2850ed932d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.165769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cfb16-a534-4b59-beda-d2850ed932d0 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.212175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488255b7-a457-4be1-9d00-83cc42c072df admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.212974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1128/2238] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:38 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:38.228442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488255b7-a457-4be1-9d00-83cc42c072df admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.266006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cfb16-a534-4b59-beda-d2850ed932d0 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.269748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-835cfb16-a534-4b59-beda-d2850ed932d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:38.341616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248705a7-1ad4-4027-90ff-f3692ab16775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.342224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248705a7-1ad4-4027-90ff-f3692ab16775 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.342607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248705a7-1ad4-4027-90ff-f3692ab16775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.342893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248705a7-1ad4-4027-90ff-f3692ab16775 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.343594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248705a7-1ad4-4027-90ff-f3692ab16775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.346637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248705a7-1ad4-4027-90ff-f3692ab16775 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.371453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1111/2239] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:38 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:38.378736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248705a7-1ad4-4027-90ff-f3692ab16775 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.389514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248705a7-1ad4-4027-90ff-f3692ab16775 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.404847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d8972-4f42-4c94-b771-c7670ab39e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.405547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d8972-4f42-4c94-b771-c7670ab39e13 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.405824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d8972-4f42-4c94-b771-c7670ab39e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.406104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d8972-4f42-4c94-b771-c7670ab39e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.406880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d8972-4f42-4c94-b771-c7670ab39e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.409519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d8972-4f42-4c94-b771-c7670ab39e13 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.409636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cfb16-a534-4b59-beda-d2850ed932d0 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.415701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.416295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.416642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.416983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] PATH_INFO: `/v3/projects/29f12b7be4aa4e8cadc0d5d99b9a04e3` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.418250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f12b7be4aa4e8cadc0d5d99b9a04e3)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.420252 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.426755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1112/2240] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:38.430134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d8972-4f42-4c94-b771-c7670ab39e13 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.441500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d8972-4f42-4c94-b771-c7670ab39e13 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.450390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5441f-314c-474a-a497-2294f6129035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.451145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5441f-314c-474a-a497-2294f6129035 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.451997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5441f-314c-474a-a497-2294f6129035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.452280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5441f-314c-474a-a497-2294f6129035 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.453038 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5441f-314c-474a-a497-2294f6129035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.456942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5441f-314c-474a-a497-2294f6129035 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.474423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1113/2241] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:38.475563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5441f-314c-474a-a497-2294f6129035 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.488423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5441f-314c-474a-a497-2294f6129035 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.490748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:38.503054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f12b7be4aa4e8cadc0d5d99b9a04e3', 'request_id': 'req-75225657-7baf-455a-b24b-e770c048969c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:38.511265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f12b7be4aa4e8cadc0d5d99b9a04e3', 'request_id': 'req-75225657-7baf-455a-b24b-e770c048969c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:38.529514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f12b7be4aa4e8cadc0d5d99b9a04e3', 'request_id': 'req-75225657-7baf-455a-b24b-e770c048969c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:38.554384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] The token cache is being invalidate because project 29f12b7be4aa4e8cadc0d5d99b9a04e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:38.555023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:38.556182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-75225657-7baf-455a-b24b-e770c048969c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:38.557262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5bb48-0755-4b0d-9e3d-7e8381276a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.558223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1129/2242] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:38 2022] DELETE /identity/v3/projects/29f12b7be4aa4e8cadc0d5d99b9a04e3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:38.558371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5bb48-0755-4b0d-9e3d-7e8381276a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.558501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5bb48-0755-4b0d-9e3d-7e8381276a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.558781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5bb48-0755-4b0d-9e3d-7e8381276a9f admin admin] PATH_INFO: `/v3/projects/4071f0e376a64f69a43d5ae6c871e15d/users/7b52822ac11046a89e37089e71a7a51e/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.562880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4cb47-496b-4e74-9b98-49cfdd419f02 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.563316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4cb47-496b-4e74-9b98-49cfdd419f02 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.563636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4cb47-496b-4e74-9b98-49cfdd419f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.577963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5bb48-0755-4b0d-9e3d-7e8381276a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4071f0e376a64f69a43d5ae6c871e15d, user_id=7b52822ac11046a89e37089e71a7a51e, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.581746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5bb48-0755-4b0d-9e3d-7e8381276a9f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.600147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8ac4cb47-496b-4e74-9b98-49cfdd419f02 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:38.601297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8ac4cb47-496b-4e74-9b98-49cfdd419f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:38.605083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1114/2243] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:38 2022] PUT /identity/v3/projects/4071f0e376a64f69a43d5ae6c871e15d/users/7b52822ac11046a89e37089e71a7a51e/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:38.621025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d345c7-df80-498b-843b-2b59171d526d None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.621846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d345c7-df80-498b-843b-2b59171d526d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.622163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d345c7-df80-498b-843b-2b59171d526d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.665902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b9d345c7-df80-498b-843b-2b59171d526d None None] MFA Rules not processed for user `7b52822ac11046a89e37089e71a7a51e`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:38.667105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b9d345c7-df80-498b-843b-2b59171d526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:38.684063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1130/2244] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:38.692427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62476-2449-4a3d-a653-bd2d699afd04 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.692717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62476-2449-4a3d-a653-bd2d699afd04 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.692996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62476-2449-4a3d-a653-bd2d699afd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.708125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:38.714628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c8e62476-2449-4a3d-a653-bd2d699afd04 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:38.716072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c8e62476-2449-4a3d-a653-bd2d699afd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:38.724710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1131/2245] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:38.728929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e62476-2449-4a3d-a653-bd2d699afd04 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.741536 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e62476-2449-4a3d-a653-bd2d699afd04 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.746175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd92739-e694-4b60-951c-dfaf7faf5604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.746872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd92739-e694-4b60-951c-dfaf7faf5604 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.747155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd92739-e694-4b60-951c-dfaf7faf5604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.747607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd92739-e694-4b60-951c-dfaf7faf5604 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.748351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd92739-e694-4b60-951c-dfaf7faf5604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:38.748647 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd92739-e694-4b60-951c-dfaf7faf5604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.750258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd92739-e694-4b60-951c-dfaf7faf5604 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.757851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1115/2246] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:38.770198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1132/2247] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:52:38.771930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d345c7-df80-498b-843b-2b59171d526d None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.774490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd92739-e694-4b60-951c-dfaf7faf5604 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.775483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b9d345c7-df80-498b-843b-2b59171d526d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:38.794444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd92739-e694-4b60-951c-dfaf7faf5604 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.802105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25668f3-b2bb-41ad-b919-f53d9ac429b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.802387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25668f3-b2bb-41ad-b919-f53d9ac429b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.802642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25668f3-b2bb-41ad-b919-f53d9ac429b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.802924 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25668f3-b2bb-41ad-b919-f53d9ac429b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.803623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25668f3-b2bb-41ad-b919-f53d9ac429b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.805908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25668f3-b2bb-41ad-b919-f53d9ac429b9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.848260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1133/2248] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:38 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:38.855233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d345c7-df80-498b-843b-2b59171d526d None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.855424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25668f3-b2bb-41ad-b919-f53d9ac429b9 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:38.933999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfca681-eff2-45b5-a322-c092a106ea9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a1696d1cc14ca6ac1cb970598f11fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.934808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca681-eff2-45b5-a322-c092a106ea9f service glance] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.935143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca681-eff2-45b5-a322-c092a106ea9f service glance] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.935428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfca681-eff2-45b5-a322-c092a106ea9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.949799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25668f3-b2bb-41ad-b919-f53d9ac429b9 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:38.960796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b390-528b-460b-b081-c2965ac5c0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:38.961492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b390-528b-460b-b081-c2965ac5c0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:38.961780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b390-528b-460b-b081-c2965ac5c0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:38.962060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b390-528b-460b-b081-c2965ac5c0d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:38.962819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33b390-528b-460b-b081-c2965ac5c0d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:38.964821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33b390-528b-460b-b081-c2965ac5c0d7 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:38.997035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1134/2249] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:38 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:38.999694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b390-528b-460b-b081-c2965ac5c0d7 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:39.011528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b390-528b-460b-b081-c2965ac5c0d7 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:39.019473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f336588-60c1-4de3-a0ff-ac8c96040ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:39.020271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f336588-60c1-4de3-a0ff-ac8c96040ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.020562 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f336588-60c1-4de3-a0ff-ac8c96040ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.020839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f336588-60c1-4de3-a0ff-ac8c96040ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:39.021614 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f336588-60c1-4de3-a0ff-ac8c96040ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:39.023390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f336588-60c1-4de3-a0ff-ac8c96040ca1 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:39.026089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:39.028180 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfca681-eff2-45b5-a322-c092a106ea9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:39.030644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfca681-eff2-45b5-a322-c092a106ea9f service glance] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:39.040341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1135/2250] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:39.041453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f336588-60c1-4de3-a0ff-ac8c96040ca1 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:39.046597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1116/2251] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:52:39.065420 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f336588-60c1-4de3-a0ff-ac8c96040ca1 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:39.071290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103c015-0743-4d7d-93a6-b8579a9c3c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:39.071987 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c015-0743-4d7d-93a6-b8579a9c3c4c admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.072371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c015-0743-4d7d-93a6-b8579a9c3c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.072557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c015-0743-4d7d-93a6-b8579a9c3c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:39.073855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103c015-0743-4d7d-93a6-b8579a9c3c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:39.075403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103c015-0743-4d7d-93a6-b8579a9c3c4c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:39.116645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1136/2252] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:39.122203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfca681-eff2-45b5-a322-c092a106ea9f service glance] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:39.145168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfca681-eff2-45b5-a322-c092a106ea9f service glance] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:39.150863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c84e76-3322-4992-9045-46d8b4147ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:39.151481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c84e76-3322-4992-9045-46d8b4147ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.151823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c84e76-3322-4992-9045-46d8b4147ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.152695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c84e76-3322-4992-9045-46d8b4147ee7 admin admin] PATH_INFO: `/v3/projects/73dd53448e704df089e8a52efc3437d9/users/e9b94950bec5494b856724753deb9fa0/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:39.187779 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c84e76-3322-4992-9045-46d8b4147ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dd53448e704df089e8a52efc3437d9, user_id=e9b94950bec5494b856724753deb9fa0, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:39.191353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c84e76-3322-4992-9045-46d8b4147ee7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:39.228710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1117/2253] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:39 2022] PUT /identity/v3/projects/73dd53448e704df089e8a52efc3437d9/users/e9b94950bec5494b856724753deb9fa0/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:39.241202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc44df-7fd3-4957-ad06-3868f620d572 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.241592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc44df-7fd3-4957-ad06-3868f620d572 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.241992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc44df-7fd3-4957-ad06-3868f620d572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:39.387767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-11fc44df-7fd3-4957-ad06-3868f620d572 None None] MFA Rules not processed for user `e9b94950bec5494b856724753deb9fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:39.389042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-11fc44df-7fd3-4957-ad06-3868f620d572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:39.532153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1137/2254] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:39.539638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c84e76-3322-4992-9045-46d8b4147ee7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:39.560482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:39.634265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c84e76-3322-4992-9045-46d8b4147ee7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:39.639221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d102b-1ba4-4913-b9d5-00dcedc12c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:39.639880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d102b-1ba4-4913-b9d5-00dcedc12c17 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.640162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d102b-1ba4-4913-b9d5-00dcedc12c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.640436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d102b-1ba4-4913-b9d5-00dcedc12c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:39.641129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d102b-1ba4-4913-b9d5-00dcedc12c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:39.643168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d102b-1ba4-4913-b9d5-00dcedc12c17 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:39.678189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1118/2255] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:39 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:39.682580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc44df-7fd3-4957-ad06-3868f620d572 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:39.697315 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc44df-7fd3-4957-ad06-3868f620d572 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:39.770402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37338c-582b-4630-b03f-7c0e4470f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:39.771035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37338c-582b-4630-b03f-7c0e4470f7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.771316 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37338c-582b-4630-b03f-7c0e4470f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.771594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37338c-582b-4630-b03f-7c0e4470f7c9 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:39.772470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37338c-582b-4630-b03f-7c0e4470f7c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:39.774427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37338c-582b-4630-b03f-7c0e4470f7c9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:39.799072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1138/2256] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:39 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:39.809410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d102b-1ba4-4913-b9d5-00dcedc12c17 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:39.821654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d102b-1ba4-4913-b9d5-00dcedc12c17 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:39.826958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661d4e-69fb-484a-b88f-457805c9fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:39.827640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661d4e-69fb-484a-b88f-457805c9fd8c admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.827969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661d4e-69fb-484a-b88f-457805c9fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.830842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661d4e-69fb-484a-b88f-457805c9fd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:39.830842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661d4e-69fb-484a-b88f-457805c9fd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:39.831759 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661d4e-69fb-484a-b88f-457805c9fd8c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:39.845194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1119/2257] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:39.850270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37338c-582b-4630-b03f-7c0e4470f7c9 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:39.862206 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37338c-582b-4630-b03f-7c0e4470f7c9 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:39.867269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc5512-3aad-4f46-a1bf-2284a259d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:39.867829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5512-3aad-4f46-a1bf-2284a259d108 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.868104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5512-3aad-4f46-a1bf-2284a259d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.868386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc5512-3aad-4f46-a1bf-2284a259d108 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:39.869112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc5512-3aad-4f46-a1bf-2284a259d108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:39.870742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc5512-3aad-4f46-a1bf-2284a259d108 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:39.893798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1139/2258] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:39.897555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661d4e-69fb-484a-b88f-457805c9fd8c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:39.912842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661d4e-69fb-484a-b88f-457805c9fd8c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:39.918212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47570f61-5412-4765-b099-8e0ac4a03e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:39.919327 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570f61-5412-4765-b099-8e0ac4a03e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.919805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570f61-5412-4765-b099-8e0ac4a03e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.920143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47570f61-5412-4765-b099-8e0ac4a03e2c admin admin] PATH_INFO: `/v3/projects/e7c73af80e3f4fdf92f6dd2d03922273/users/b5b28db617e84bb6b54791cc37c72965/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:39.937600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570f61-5412-4765-b099-8e0ac4a03e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c73af80e3f4fdf92f6dd2d03922273, user_id=b5b28db617e84bb6b54791cc37c72965, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:39.941481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47570f61-5412-4765-b099-8e0ac4a03e2c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:39.958965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1120/2259] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:39 2022] PUT /identity/v3/projects/e7c73af80e3f4fdf92f6dd2d03922273/users/b5b28db617e84bb6b54791cc37c72965/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:39.970799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bb2ca-3446-4e87-9618-fdebb9a9c88a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:39.971196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bb2ca-3446-4e87-9618-fdebb9a9c88a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:39.971494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bb2ca-3446-4e87-9618-fdebb9a9c88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.000422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-847bb2ca-3446-4e87-9618-fdebb9a9c88a None None] MFA Rules not processed for user `b5b28db617e84bb6b54791cc37c72965`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:40.001678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-847bb2ca-3446-4e87-9618-fdebb9a9c88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:40.046379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:40.055559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25810041-6fd1-48fb-8fe9-fa1952ddd0c6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.055983 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25810041-6fd1-48fb-8fe9-fa1952ddd0c6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.056403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25810041-6fd1-48fb-8fe9-fa1952ddd0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.076580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-25810041-6fd1-48fb-8fe9-fa1952ddd0c6 None None] MFA Rules not processed for user `6dbb7fcbd9604a87a8b4dd380ca9cd56`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:40.078643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-25810041-6fd1-48fb-8fe9-fa1952ddd0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:40.084711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1140/2260] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:40.085666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bb2ca-3446-4e87-9618-fdebb9a9c88a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:40.146847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1121/2261] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:40.160278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bb2ca-3446-4e87-9618-fdebb9a9c88a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:40.166539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafb53a-2d1c-4124-b85d-c2de24009eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:40.167215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafb53a-2d1c-4124-b85d-c2de24009eae admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.167500 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafb53a-2d1c-4124-b85d-c2de24009eae admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.167782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafb53a-2d1c-4124-b85d-c2de24009eae admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.168492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafb53a-2d1c-4124-b85d-c2de24009eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:40.170416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafb53a-2d1c-4124-b85d-c2de24009eae admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:40.212563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1141/2262] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:40 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:40.216402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25810041-6fd1-48fb-8fe9-fa1952ddd0c6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:40.228539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25810041-6fd1-48fb-8fe9-fa1952ddd0c6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:40.292613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917bab3-4966-4ccd-a0de-e0da122e83de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:40.293288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917bab3-4966-4ccd-a0de-e0da122e83de admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.293571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917bab3-4966-4ccd-a0de-e0da122e83de admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.293872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917bab3-4966-4ccd-a0de-e0da122e83de admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.294610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917bab3-4966-4ccd-a0de-e0da122e83de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:40.296540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917bab3-4966-4ccd-a0de-e0da122e83de admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:40.315892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:40.323109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1122/2263] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:40 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:40.328412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafb53a-2d1c-4124-b85d-c2de24009eae admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:40.340923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917bab3-4966-4ccd-a0de-e0da122e83de admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:40.343271 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6917bab3-4966-4ccd-a0de-e0da122e83de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:40.346226 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafb53a-2d1c-4124-b85d-c2de24009eae admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:40.352175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e29509-a280-41e0-82f9-c8a4e1967970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:40.353087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e29509-a280-41e0-82f9-c8a4e1967970 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.353424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e29509-a280-41e0-82f9-c8a4e1967970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.353767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e29509-a280-41e0-82f9-c8a4e1967970 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.354677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e29509-a280-41e0-82f9-c8a4e1967970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:40.356469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e29509-a280-41e0-82f9-c8a4e1967970 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:40.357035 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917bab3-4966-4ccd-a0de-e0da122e83de admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:40.363173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:40.364575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.364865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.365146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] PATH_INFO: `/v3/users/34c3dda77fb3485ea17b6c3bf8a43f99` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.366432 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c3dda77fb3485ea17b6c3bf8a43f99)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:40.368381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:40.372931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1142/2264] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:40.377619 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e29509-a280-41e0-82f9-c8a4e1967970 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:40.389465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e29509-a280-41e0-82f9-c8a4e1967970 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:40.395169 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2357f-3287-4bc5-84de-ca5c973c5c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:40.396154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2357f-3287-4bc5-84de-ca5c973c5c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.396573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2357f-3287-4bc5-84de-ca5c973c5c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.396852 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2357f-3287-4bc5-84de-ca5c973c5c25 admin admin] PATH_INFO: `/v3/projects/a74c3fc70cac44e7a73499cabae7fce1/users/7064241393fb44ba93b92ecf8dede5e1/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.427786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2357f-3287-4bc5-84de-ca5c973c5c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74c3fc70cac44e7a73499cabae7fce1, user_id=7064241393fb44ba93b92ecf8dede5e1, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:40.431446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2357f-3287-4bc5-84de-ca5c973c5c25 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:40.439702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c3dda77fb3485ea17b6c3bf8a43f99'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:40.440745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c3dda77fb3485ea17b6c3bf8a43f99'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:40.448893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1143/2265] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:40 2022] PUT /identity/v3/projects/a74c3fc70cac44e7a73499cabae7fce1/users/7064241393fb44ba93b92ecf8dede5e1/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:40.454418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2357f-3287-4bc5-84de-ca5c973c5c25 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:40.457096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c7b2357f-3287-4bc5-84de-ca5c973c5c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:40.457643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c3dda77fb3485ea17b6c3bf8a43f99'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:40.465932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c3dda77fb3485ea17b6c3bf8a43f99'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:40.476716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-bd61bb0a-3932-4d2a-9edd-0d14e897281a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c3dda77fb3485ea17b6c3bf8a43f99'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:40.484139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1123/2266] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:40 2022] DELETE /identity/v3/users/34c3dda77fb3485ea17b6c3bf8a43f99 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:40.488251 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ceba-8588-4be3-b74f-b9300387cebe None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.488545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ceba-8588-4be3-b74f-b9300387cebe None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.488832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782ceba-8588-4be3-b74f-b9300387cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.507745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-4782ceba-8588-4be3-b74f-b9300387cebe None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:40.509381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4782ceba-8588-4be3-b74f-b9300387cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:40.553282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2357f-3287-4bc5-84de-ca5c973c5c25 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:40.583791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1124/2267] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:40.595029 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782ceba-8588-4be3-b74f-b9300387cebe None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:40.598212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4782ceba-8588-4be3-b74f-b9300387cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:40.602382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:40.630705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261813c-a988-4ecf-ab83-62d8b018f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:40.633811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261813c-a988-4ecf-ab83-62d8b018f7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.634208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261813c-a988-4ecf-ab83-62d8b018f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.634548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261813c-a988-4ecf-ab83-62d8b018f7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.635343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261813c-a988-4ecf-ab83-62d8b018f7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:40.636991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261813c-a988-4ecf-ab83-62d8b018f7a9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:40.656670 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1144/2268] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:52:40.659710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261813c-a988-4ecf-ab83-62d8b018f7a9 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:40.671283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261813c-a988-4ecf-ab83-62d8b018f7a9 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:40.677535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e547b6-1631-4614-ae0e-df065ede2e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:40.679538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e547b6-1631-4614-ae0e-df065ede2e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.679828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e547b6-1631-4614-ae0e-df065ede2e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.680166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e547b6-1631-4614-ae0e-df065ede2e85 admin admin] PATH_INFO: `/v3/projects/a74c3fc70cac44e7a73499cabae7fce1/users/7064241393fb44ba93b92ecf8dede5e1/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.682216 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e547b6-1631-4614-ae0e-df065ede2e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74c3fc70cac44e7a73499cabae7fce1, user_id=7064241393fb44ba93b92ecf8dede5e1, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:40.684950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e547b6-1631-4614-ae0e-df065ede2e85 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:40.702761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1145/2269] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:40 2022] PUT /identity/v3/projects/a74c3fc70cac44e7a73499cabae7fce1/users/7064241393fb44ba93b92ecf8dede5e1/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:40.709788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782ceba-8588-4be3-b74f-b9300387cebe None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:40.714117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087b21-5a17-4c5b-addd-2baa1d7bb77c None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.714882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087b21-5a17-4c5b-addd-2baa1d7bb77c None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.715414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9087b21-5a17-4c5b-addd-2baa1d7bb77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.752010 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:40.771687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c9087b21-5a17-4c5b-addd-2baa1d7bb77c None None] MFA Rules not processed for user `7064241393fb44ba93b92ecf8dede5e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:40.773453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c9087b21-5a17-4c5b-addd-2baa1d7bb77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:40.790551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156f19b-4bfe-4525-aa6d-da2c6c4f54d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:40.791297 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156f19b-4bfe-4525-aa6d-da2c6c4f54d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.791675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156f19b-4bfe-4525-aa6d-da2c6c4f54d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.792187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156f19b-4bfe-4525-aa6d-da2c6c4f54d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.871471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1146/2270] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:40.883178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087b21-5a17-4c5b-addd-2baa1d7bb77c None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:40.885032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c9087b21-5a17-4c5b-addd-2baa1d7bb77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:40.903594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156f19b-4bfe-4525-aa6d-da2c6c4f54d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:40.905054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156f19b-4bfe-4525-aa6d-da2c6c4f54d5 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:40.917792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1125/2271] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:52:40.982975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9087b21-5a17-4c5b-addd-2baa1d7bb77c None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:40.990937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d498427-a557-4c00-a187-a65d5162eb64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:40.991693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498427-a557-4c00-a187-a65d5162eb64 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:40.992050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498427-a557-4c00-a187-a65d5162eb64 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:40.992408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d498427-a557-4c00-a187-a65d5162eb64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:40.994728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2d498427-a557-4c00-a187-a65d5162eb64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:41.071214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d498427-a557-4c00-a187-a65d5162eb64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:41.072603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d498427-a557-4c00-a187-a65d5162eb64 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:41.083812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1147/2272] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:41.291174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156f19b-4bfe-4525-aa6d-da2c6c4f54d5 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:41.293385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8156f19b-4bfe-4525-aa6d-da2c6c4f54d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:41.346752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156f19b-4bfe-4525-aa6d-da2c6c4f54d5 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:41.351668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:41.352532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.352816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.353098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] PATH_INFO: `/v3/projects/c295c57d982541c0b9d8d7cc09259c40` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:41.354305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c295c57d982541c0b9d8d7cc09259c40)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:41.356922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:41.431507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c295c57d982541c0b9d8d7cc09259c40', 'request_id': 'req-e3806882-08ff-4c0b-aa71-02f11907b536'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:41.442136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c295c57d982541c0b9d8d7cc09259c40', 'request_id': 'req-e3806882-08ff-4c0b-aa71-02f11907b536'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:41.450678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c295c57d982541c0b9d8d7cc09259c40', 'request_id': 'req-e3806882-08ff-4c0b-aa71-02f11907b536'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:41.489801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] The token cache is being invalidate because project c295c57d982541c0b9d8d7cc09259c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:41.489801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:41.489801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e3806882-08ff-4c0b-aa71-02f11907b536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:41.489801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1126/2273] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:41 2022] DELETE /identity/v3/projects/c295c57d982541c0b9d8d7cc09259c40 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:41.491010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5c1ef-6be9-4169-ad29-dad81535a906 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.491010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5c1ef-6be9-4169-ad29-dad81535a906 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.491529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5c1ef-6be9-4169-ad29-dad81535a906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:41.498567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:41.515055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-37b5c1ef-6be9-4169-ad29-dad81535a906 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:41.516917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-37b5c1ef-6be9-4169-ad29-dad81535a906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:41.585444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1148/2274] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:41.593297 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40665-2bad-4afd-ab56-87ae9c887bc6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.593590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40665-2bad-4afd-ab56-87ae9c887bc6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.593878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef40665-2bad-4afd-ab56-87ae9c887bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:41.616700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-bef40665-2bad-4afd-ab56-87ae9c887bc6 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:41.617961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bef40665-2bad-4afd-ab56-87ae9c887bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:41.626385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1127/2275] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:41.630798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5c1ef-6be9-4169-ad29-dad81535a906 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:41.640495 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5c1ef-6be9-4169-ad29-dad81535a906 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:41.645451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541784-bc8e-4dea-a10e-15646407762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:41.646161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541784-bc8e-4dea-a10e-15646407762b admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.646485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541784-bc8e-4dea-a10e-15646407762b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.646791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541784-bc8e-4dea-a10e-15646407762b admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:41.647515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73541784-bc8e-4dea-a10e-15646407762b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:41.647822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73541784-bc8e-4dea-a10e-15646407762b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:41.649411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73541784-bc8e-4dea-a10e-15646407762b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:41.661915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1149/2276] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:52:41.666185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef40665-2bad-4afd-ab56-87ae9c887bc6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:41.676376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef40665-2bad-4afd-ab56-87ae9c887bc6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:41.681260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227bf6a-4115-4790-a0a0-468b8dbeb36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:41.681803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227bf6a-4115-4790-a0a0-468b8dbeb36d admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.682148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227bf6a-4115-4790-a0a0-468b8dbeb36d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.682984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227bf6a-4115-4790-a0a0-468b8dbeb36d admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:41.683448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227bf6a-4115-4790-a0a0-468b8dbeb36d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:41.684957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227bf6a-4115-4790-a0a0-468b8dbeb36d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:41.712885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1128/2277] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:41 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:41.717067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541784-bc8e-4dea-a10e-15646407762b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:41.727814 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541784-bc8e-4dea-a10e-15646407762b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:41.784874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8056d-1ddb-466b-a8d3-a55ece2e25da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:41.785503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8056d-1ddb-466b-a8d3-a55ece2e25da admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.785798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8056d-1ddb-466b-a8d3-a55ece2e25da admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.786093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8056d-1ddb-466b-a8d3-a55ece2e25da admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:41.786918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8056d-1ddb-466b-a8d3-a55ece2e25da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:41.788937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8056d-1ddb-466b-a8d3-a55ece2e25da admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:41.813410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1150/2278] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:41 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:52:41.814863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227bf6a-4115-4790-a0a0-468b8dbeb36d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:41.825822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227bf6a-4115-4790-a0a0-468b8dbeb36d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:41.830582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc26c0-d21a-47b3-add8-383399da780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:41.831232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc26c0-d21a-47b3-add8-383399da780d admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.831521 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc26c0-d21a-47b3-add8-383399da780d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.831803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc26c0-d21a-47b3-add8-383399da780d admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:41.832532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc26c0-d21a-47b3-add8-383399da780d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:41.834147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc26c0-d21a-47b3-add8-383399da780d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:41.844546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1129/2279] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:41.848831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8056d-1ddb-466b-a8d3-a55ece2e25da admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:41.858955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8056d-1ddb-466b-a8d3-a55ece2e25da admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:41.864430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8cfc2-5f02-4657-8261-fcf88723bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:41.865091 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8cfc2-5f02-4657-8261-fcf88723bba2 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.865392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8cfc2-5f02-4657-8261-fcf88723bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.865664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8cfc2-5f02-4657-8261-fcf88723bba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:41.866417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8cfc2-5f02-4657-8261-fcf88723bba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:41.868028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8cfc2-5f02-4657-8261-fcf88723bba2 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:41.881386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1151/2280] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:41.886479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc26c0-d21a-47b3-add8-383399da780d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:41.899594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc26c0-d21a-47b3-add8-383399da780d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:41.905362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4e286-4bfb-4f77-b5cd-9f6181b247d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:41.906474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4e286-4bfb-4f77-b5cd-9f6181b247d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.906760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4e286-4bfb-4f77-b5cd-9f6181b247d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.907035 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4e286-4bfb-4f77-b5cd-9f6181b247d9 admin admin] PATH_INFO: `/v3/projects/dd4d7bf0c68c487db87e7bf6c6585776/users/ca7a8329a3bc4be4a7fde7c7e3e969f4/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:41.925644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4e286-4bfb-4f77-b5cd-9f6181b247d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4d7bf0c68c487db87e7bf6c6585776, user_id=ca7a8329a3bc4be4a7fde7c7e3e969f4, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:41.928401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4e286-4bfb-4f77-b5cd-9f6181b247d9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:41.932182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:41.949021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1130/2281] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:41 2022] PUT /identity/v3/projects/dd4d7bf0c68c487db87e7bf6c6585776/users/ca7a8329a3bc4be4a7fde7c7e3e969f4/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:41.964155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544a163-8557-40ca-8294-8859be5301ca None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:41.964446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544a163-8557-40ca-8294-8859be5301ca None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:41.964725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544a163-8557-40ca-8294-8859be5301ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:42.012674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0544a163-8557-40ca-8294-8859be5301ca None None] MFA Rules not processed for user `ca7a8329a3bc4be4a7fde7c7e3e969f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:42.021980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0544a163-8557-40ca-8294-8859be5301ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:42.109201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:42.125558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1152/2282] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:52:42.149937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4e286-4bfb-4f77-b5cd-9f6181b247d9 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:42.153164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-84b4e286-4bfb-4f77-b5cd-9f6181b247d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:42.254272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4e286-4bfb-4f77-b5cd-9f6181b247d9 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:42.258240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2827a-cb2e-4b5c-8dbb-734b101617b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:42.259078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2827a-cb2e-4b5c-8dbb-734b101617b3 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:42.259512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2827a-cb2e-4b5c-8dbb-734b101617b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:42.259849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2827a-cb2e-4b5c-8dbb-734b101617b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:42.283990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2827a-cb2e-4b5c-8dbb-734b101617b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:42.285370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2827a-cb2e-4b5c-8dbb-734b101617b3 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:42.306378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1131/2283] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:42.480595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883dff-e47e-437e-9588-45046b62a3de None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:42.481302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883dff-e47e-437e-9588-45046b62a3de None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:42.482441 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95883dff-e47e-437e-9588-45046b62a3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:42.530121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-95883dff-e47e-437e-9588-45046b62a3de None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:42.531572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-95883dff-e47e-437e-9588-45046b62a3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:42.638522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1153/2284] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:42.648346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2827a-cb2e-4b5c-8dbb-734b101617b3 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:42.649994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-96f2827a-cb2e-4b5c-8dbb-734b101617b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:42.863171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2827a-cb2e-4b5c-8dbb-734b101617b3 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:42.870488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee176-d621-463c-8d15-39556a01cfdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:42.871238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee176-d621-463c-8d15-39556a01cfdc service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:42.871600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee176-d621-463c-8d15-39556a01cfdc service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:42.871956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee176-d621-463c-8d15-39556a01cfdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:42.893737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ee176-d621-463c-8d15-39556a01cfdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:42.896020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ee176-d621-463c-8d15-39556a01cfdc service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:42.897484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883dff-e47e-437e-9588-45046b62a3de None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:42.908586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1132/2285] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:52:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:52:42.921312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95883dff-e47e-437e-9588-45046b62a3de None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:42.927042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:42.927714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:42.927998 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:42.928272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:42.930692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:43.004338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:43.005792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:43.016513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1154/2286] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:44.082993 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee176-d621-463c-8d15-39556a01cfdc service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:44.092818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee176-d621-463c-8d15-39556a01cfdc service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:44.097011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f23a30-7882-4c16-8056-fd8b118820f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:44.097902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f23a30-7882-4c16-8056-fd8b118820f7 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:44.098187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f23a30-7882-4c16-8056-fd8b118820f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:44.098503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f23a30-7882-4c16-8056-fd8b118820f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:44.100446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-38f23a30-7882-4c16-8056-fd8b118820f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:44.191791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f23a30-7882-4c16-8056-fd8b118820f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:44.193305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f23a30-7882-4c16-8056-fd8b118820f7 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:44.210913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1133/2287] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:49.453110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:49.455959 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:49.571541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5b132-0877-4c54-8594-cfd7d920d8be service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:49.577555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:49.578904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:49.579377 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:49.580192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] PATH_INFO: `/v3/users/e9b94950bec5494b856724753deb9fa0` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:49.582067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b94950bec5494b856724753deb9fa0)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:49.584222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:49.643679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:49.663637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b94950bec5494b856724753deb9fa0'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:49.664541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b94950bec5494b856724753deb9fa0'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:49.665223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b94950bec5494b856724753deb9fa0'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:49.685911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b94950bec5494b856724753deb9fa0'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:49.732115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b94950bec5494b856724753deb9fa0'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:49.820049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1155/2288] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:49 2022] DELETE /identity/v3/users/e9b94950bec5494b856724753deb9fa0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:49.824495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbeaca-ce85-4eda-9cdc-ebdccb22e6bf None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:49.825746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbeaca-ce85-4eda-9cdc-ebdccb22e6bf None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:49.827504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbeaca-ce85-4eda-9cdc-ebdccb22e6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:49.866788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-14dbeaca-ce85-4eda-9cdc-ebdccb22e6bf None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:49.868799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-14dbeaca-ce85-4eda-9cdc-ebdccb22e6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:49.896584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:49.965811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1134/2289] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:49.983323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:49.984743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:50.090516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1b2c4-6ba5-4474-9cf4-981413334068 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:50.096728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6203204-3334-4c44-8d7b-00ecd6eb2e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:50.098665 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203204-3334-4c44-8d7b-00ecd6eb2e03 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:50.099163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203204-3334-4c44-8d7b-00ecd6eb2e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:50.099654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6203204-3334-4c44-8d7b-00ecd6eb2e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:50.111842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6203204-3334-4c44-8d7b-00ecd6eb2e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:50.113778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6203204-3334-4c44-8d7b-00ecd6eb2e03 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:50.128563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1156/2290] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:50.774807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbeaca-ce85-4eda-9cdc-ebdccb22e6bf None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:50.774807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-14dbeaca-ce85-4eda-9cdc-ebdccb22e6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:50.803800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbeaca-ce85-4eda-9cdc-ebdccb22e6bf None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:50.822279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:50.823138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:50.823706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:50.824065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] PATH_INFO: `/v3/projects/73dd53448e704df089e8a52efc3437d9` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:50.825264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73dd53448e704df089e8a52efc3437d9)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:50.827262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:50.913476 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73dd53448e704df089e8a52efc3437d9', 'request_id': 'req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:50.926030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73dd53448e704df089e8a52efc3437d9', 'request_id': 'req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:50.943174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73dd53448e704df089e8a52efc3437d9', 'request_id': 'req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:50.957370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] The token cache is being invalidate because project 73dd53448e704df089e8a52efc3437d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:50.957661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:50.958403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:50.962979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1135/2291] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:50 2022] DELETE /identity/v3/projects/73dd53448e704df089e8a52efc3437d9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:50.964685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6203204-3334-4c44-8d7b-00ecd6eb2e03 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:50.981282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6203204-3334-4c44-8d7b-00ecd6eb2e03 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:51.084228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:51.085426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:51.085884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:51.086397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] PATH_INFO: `/v3/users/b5b28db617e84bb6b54791cc37c72965` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:51.087822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b28db617e84bb6b54791cc37c72965)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:51.101384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:51.179235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b28db617e84bb6b54791cc37c72965'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.180228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b28db617e84bb6b54791cc37c72965'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.181256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b28db617e84bb6b54791cc37c72965'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.190308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:51.203126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b28db617e84bb6b54791cc37c72965'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.214819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b28db617e84bb6b54791cc37c72965'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.250362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1157/2292] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:50 2022] DELETE /identity/v3/users/b5b28db617e84bb6b54791cc37c72965 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:51.681591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:51.683174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:51.697235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5c63f-4471-4209-bb35-eaa3f30ce7d2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:51.764006 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:51.765314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:51.765705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:51.766287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] PATH_INFO: `/v3/projects/e7c73af80e3f4fdf92f6dd2d03922273` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:51.768094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c73af80e3f4fdf92f6dd2d03922273)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:51.770215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:51.842941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:51.846207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c73af80e3f4fdf92f6dd2d03922273', 'request_id': 'req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.856394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c73af80e3f4fdf92f6dd2d03922273', 'request_id': 'req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.865013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c73af80e3f4fdf92f6dd2d03922273', 'request_id': 'req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.881547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] The token cache is being invalidate because project e7c73af80e3f4fdf92f6dd2d03922273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:51.881885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.882574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:51.884139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1136/2293] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:51 2022] DELETE /identity/v3/projects/e7c73af80e3f4fdf92f6dd2d03922273 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:51.888171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:51.889666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:51.904550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91e230-810e-470c-b575-736a7efd942a admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:51.966291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:51.967217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:51.967502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:51.967781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] PATH_INFO: `/v3/users/7064241393fb44ba93b92ecf8dede5e1` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:51.969011 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7064241393fb44ba93b92ecf8dede5e1)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:51.972454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:52.024011 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7064241393fb44ba93b92ecf8dede5e1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.024715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7064241393fb44ba93b92ecf8dede5e1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.025749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7064241393fb44ba93b92ecf8dede5e1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.045832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7064241393fb44ba93b92ecf8dede5e1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.054424 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bbc4096d-9d97-4b28-9e35-3434285784ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7064241393fb44ba93b92ecf8dede5e1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.079503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1158/2294] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:51 2022] DELETE /identity/v3/users/7064241393fb44ba93b92ecf8dede5e1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:52.512849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:52.514305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:52.529166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9c5cf-ec58-4240-b0e7-5c23594d8a0f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:52.603894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:52.604764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:52.605043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:52.605341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] PATH_INFO: `/v3/projects/a74c3fc70cac44e7a73499cabae7fce1` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:52.617512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74c3fc70cac44e7a73499cabae7fce1)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:52.621770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:52.703018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74c3fc70cac44e7a73499cabae7fce1', 'request_id': 'req-ad7d3961-c010-4e0c-853b-c45db184c984'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.717822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74c3fc70cac44e7a73499cabae7fce1', 'request_id': 'req-ad7d3961-c010-4e0c-853b-c45db184c984'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.724648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74c3fc70cac44e7a73499cabae7fce1', 'request_id': 'req-ad7d3961-c010-4e0c-853b-c45db184c984'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.743104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] The token cache is being invalidate because project a74c3fc70cac44e7a73499cabae7fce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:52.743403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.744219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ad7d3961-c010-4e0c-853b-c45db184c984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:52.746273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1137/2295] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:52 2022] DELETE /identity/v3/projects/a74c3fc70cac44e7a73499cabae7fce1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:52.751637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737603f-ef42-4b83-b643-50b33d805fb5 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:52.751637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737603f-ef42-4b83-b643-50b33d805fb5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:52.751637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737603f-ef42-4b83-b643-50b33d805fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:52.774241 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-6737603f-ef42-4b83-b643-50b33d805fb5 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:52.775964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6737603f-ef42-4b83-b643-50b33d805fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:52.868732 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:52.885602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1159/2296] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:52.894409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979960e-f447-43b2-abe6-b259a64705af None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:52.894958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979960e-f447-43b2-abe6-b259a64705af None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:52.895222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979960e-f447-43b2-abe6-b259a64705af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:52.917138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-1979960e-f447-43b2-abe6-b259a64705af None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:52.918387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1979960e-f447-43b2-abe6-b259a64705af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:52.927592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1138/2297] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:52.932603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737603f-ef42-4b83-b643-50b33d805fb5 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:52.943584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737603f-ef42-4b83-b643-50b33d805fb5 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:52.949236 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a07f2-dbd7-4dc7-a972-d0ccd514e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:52.950000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a07f2-dbd7-4dc7-a972-d0ccd514e98e admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:52.950477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a07f2-dbd7-4dc7-a972-d0ccd514e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:52.950764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a07f2-dbd7-4dc7-a972-d0ccd514e98e admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:52.952254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a07f2-dbd7-4dc7-a972-d0ccd514e98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:52.952632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a07f2-dbd7-4dc7-a972-d0ccd514e98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:52.955141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a07f2-dbd7-4dc7-a972-d0ccd514e98e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:52.967674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1160/2298] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:52:52.972874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979960e-f447-43b2-abe6-b259a64705af None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:52.982189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979960e-f447-43b2-abe6-b259a64705af None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:52.987865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866503-9486-4506-88c5-3c0206bea7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:52.988512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866503-9486-4506-88c5-3c0206bea7df admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:52.988800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866503-9486-4506-88c5-3c0206bea7df admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:52.989098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866503-9486-4506-88c5-3c0206bea7df admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:52.989773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7866503-9486-4506-88c5-3c0206bea7df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:52.991721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7866503-9486-4506-88c5-3c0206bea7df admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:53.028727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1139/2299] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:52 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:53.040458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a07f2-dbd7-4dc7-a972-d0ccd514e98e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:53.052553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a07f2-dbd7-4dc7-a972-d0ccd514e98e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:53.120085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528c7b-d583-473c-9cac-b58ebe0c7248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:53.120786 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528c7b-d583-473c-9cac-b58ebe0c7248 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:53.121069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528c7b-d583-473c-9cac-b58ebe0c7248 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:53.121344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3528c7b-d583-473c-9cac-b58ebe0c7248 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:53.122263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3528c7b-d583-473c-9cac-b58ebe0c7248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:53.124210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3528c7b-d583-473c-9cac-b58ebe0c7248 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:53.144218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1161/2300] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:53 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:53.148975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866503-9486-4506-88c5-3c0206bea7df admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:53.161023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866503-9486-4506-88c5-3c0206bea7df admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:53.174637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d53fc9-a2c7-4f1f-8de6-df153ad569a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:53.175366 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d53fc9-a2c7-4f1f-8de6-df153ad569a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:53.175704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d53fc9-a2c7-4f1f-8de6-df153ad569a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:53.176063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d53fc9-a2c7-4f1f-8de6-df153ad569a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:53.176834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d53fc9-a2c7-4f1f-8de6-df153ad569a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:53.178694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d53fc9-a2c7-4f1f-8de6-df153ad569a2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:53.190337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1140/2301] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:53.195467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528c7b-d583-473c-9cac-b58ebe0c7248 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:53.209602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3528c7b-d583-473c-9cac-b58ebe0c7248 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:53.214659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4383c-42e5-46da-899a-d3c68b809fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:53.215335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4383c-42e5-46da-899a-d3c68b809fbd admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:53.215594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4383c-42e5-46da-899a-d3c68b809fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:53.215870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4383c-42e5-46da-899a-d3c68b809fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:53.216649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4383c-42e5-46da-899a-d3c68b809fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:53.218197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4383c-42e5-46da-899a-d3c68b809fbd admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:53.231072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1162/2302] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:53.235289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d53fc9-a2c7-4f1f-8de6-df153ad569a2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:53.246143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d53fc9-a2c7-4f1f-8de6-df153ad569a2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:53.250822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484a306-b35d-4ed1-a463-cd3b49eb7cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:53.251719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484a306-b35d-4ed1-a463-cd3b49eb7cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:53.252004 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484a306-b35d-4ed1-a463-cd3b49eb7cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:53.252277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484a306-b35d-4ed1-a463-cd3b49eb7cd7 admin admin] PATH_INFO: `/v3/projects/33d03af3f8904c829e5a04755f7e3c1b/users/9ba1d9d9fe3c4f93b5caa347997814b2/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:53.268510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484a306-b35d-4ed1-a463-cd3b49eb7cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d03af3f8904c829e5a04755f7e3c1b, user_id=9ba1d9d9fe3c4f93b5caa347997814b2, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:53.277389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484a306-b35d-4ed1-a463-cd3b49eb7cd7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:53.293596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1141/2303] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:53 2022] PUT /identity/v3/projects/33d03af3f8904c829e5a04755f7e3c1b/users/9ba1d9d9fe3c4f93b5caa347997814b2/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:53.298874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73126-a1a7-447f-b3c7-061d7b524d0e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:53.299166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73126-a1a7-447f-b3c7-061d7b524d0e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:53.299446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d73126-a1a7-447f-b3c7-061d7b524d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:53.320231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-99d73126-a1a7-447f-b3c7-061d7b524d0e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:53.321478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-99d73126-a1a7-447f-b3c7-061d7b524d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:53.392480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1163/2304] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:53.402667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484a306-b35d-4ed1-a463-cd3b49eb7cd7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:53.404535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4484a306-b35d-4ed1-a463-cd3b49eb7cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:53.410918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:53.473310 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484a306-b35d-4ed1-a463-cd3b49eb7cd7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:53.477213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb335d-9c1a-491d-9f8a-12e99a92e6b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:53.477859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb335d-9c1a-491d-9f8a-12e99a92e6b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:53.478146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb335d-9c1a-491d-9f8a-12e99a92e6b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:53.478475 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb335d-9c1a-491d-9f8a-12e99a92e6b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:53.490042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb335d-9c1a-491d-9f8a-12e99a92e6b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:53.491571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb335d-9c1a-491d-9f8a-12e99a92e6b9 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:53.504978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1142/2305] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:54.389171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e429103-a0aa-430c-b25f-37d5e406f289 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:54.389776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e429103-a0aa-430c-b25f-37d5e406f289 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:54.389776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e429103-a0aa-430c-b25f-37d5e406f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:54.420754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8e429103-a0aa-430c-b25f-37d5e406f289 None None] MFA Rules not processed for user `9ba1d9d9fe3c4f93b5caa347997814b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:54.422466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8e429103-a0aa-430c-b25f-37d5e406f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:54.481998 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:54.547442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1164/2306] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:54.559277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb335d-9c1a-491d-9f8a-12e99a92e6b9 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:54.560775 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-64fb335d-9c1a-491d-9f8a-12e99a92e6b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:54.629342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb335d-9c1a-491d-9f8a-12e99a92e6b9 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:54.632935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdebdf-1fd0-4afd-bc0a-29d7e8014642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:54.633570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdebdf-1fd0-4afd-bc0a-29d7e8014642 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:54.633851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdebdf-1fd0-4afd-bc0a-29d7e8014642 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:54.634128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdebdf-1fd0-4afd-bc0a-29d7e8014642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:54.645133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdebdf-1fd0-4afd-bc0a-29d7e8014642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:54.647155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdebdf-1fd0-4afd-bc0a-29d7e8014642 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:54.658578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1143/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:54.706690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e429103-a0aa-430c-b25f-37d5e406f289 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:54.708120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8e429103-a0aa-430c-b25f-37d5e406f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:54.723361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e429103-a0aa-430c-b25f-37d5e406f289 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:54.727996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:54.728871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:54.729153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:54.729429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] PATH_INFO: `/v3/users/ca7a8329a3bc4be4a7fde7c7e3e969f4` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:54.730812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7a8329a3bc4be4a7fde7c7e3e969f4)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:54.732776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:54.784020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7a8329a3bc4be4a7fde7c7e3e969f4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:54.784703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7a8329a3bc4be4a7fde7c7e3e969f4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:54.785528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7a8329a3bc4be4a7fde7c7e3e969f4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:54.805872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7a8329a3bc4be4a7fde7c7e3e969f4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:54.816635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7a8329a3bc4be4a7fde7c7e3e969f4'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:54.833135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1165/2308] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:52:54 2022] DELETE /identity/v3/users/ca7a8329a3bc4be4a7fde7c7e3e969f4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:54.838283 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e4246-09fc-4cad-9f64-d692ab26c70f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:54.838684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e4246-09fc-4cad-9f64-d692ab26c70f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:54.839057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e4246-09fc-4cad-9f64-d692ab26c70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:54.860041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7d1e4246-09fc-4cad-9f64-d692ab26c70f None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:54.862103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7d1e4246-09fc-4cad-9f64-d692ab26c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:54.929938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1144/2309] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:54.940525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:54.942382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:55.018176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd4574-b242-4468-8c3a-89595db6e3ec admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:55.022002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6142de1-44b2-460f-86ce-3416a13f929e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:55.022592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142de1-44b2-460f-86ce-3416a13f929e service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.022881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142de1-44b2-460f-86ce-3416a13f929e service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.023158 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6142de1-44b2-460f-86ce-3416a13f929e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.033558 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6142de1-44b2-460f-86ce-3416a13f929e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:55.035049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6142de1-44b2-460f-86ce-3416a13f929e service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:55.045511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1166/2310] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:55.331455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e4246-09fc-4cad-9f64-d692ab26c70f None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:55.333195 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7d1e4246-09fc-4cad-9f64-d692ab26c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:55.352589 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e4246-09fc-4cad-9f64-d692ab26c70f None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:55.358746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:55.359697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.360304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.360560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] PATH_INFO: `/v3/projects/dd4d7bf0c68c487db87e7bf6c6585776` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.362667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4d7bf0c68c487db87e7bf6c6585776)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:55.364880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:55.413893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:55.417885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4d7bf0c68c487db87e7bf6c6585776', 'request_id': 'req-ae88fa2a-8f49-42ca-b145-1d2ef385070d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:55.426254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4d7bf0c68c487db87e7bf6c6585776', 'request_id': 'req-ae88fa2a-8f49-42ca-b145-1d2ef385070d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:55.432725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4d7bf0c68c487db87e7bf6c6585776', 'request_id': 'req-ae88fa2a-8f49-42ca-b145-1d2ef385070d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:55.442942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] The token cache is being invalidate because project dd4d7bf0c68c487db87e7bf6c6585776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:52:55.443232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:55.443863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae88fa2a-8f49-42ca-b145-1d2ef385070d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:52:55.445406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1145/2311] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:52:55 2022] DELETE /identity/v3/projects/dd4d7bf0c68c487db87e7bf6c6585776 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:52:55.450534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f7b55-a429-4bf0-b1df-4f14b1933a50 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.451021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f7b55-a429-4bf0-b1df-4f14b1933a50 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.451113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f7b55-a429-4bf0-b1df-4f14b1933a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.468757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-1e2f7b55-a429-4bf0-b1df-4f14b1933a50 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:55.470014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-1e2f7b55-a429-4bf0-b1df-4f14b1933a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:55.528991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1167/2312] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:55.537360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd2b0-dc9b-41d8-ab09-9cd97ebbf79a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.537650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd2b0-dc9b-41d8-ab09-9cd97ebbf79a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.537933 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd2b0-dc9b-41d8-ab09-9cd97ebbf79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.557210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-389bd2b0-dc9b-41d8-ab09-9cd97ebbf79a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:55.558453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-389bd2b0-dc9b-41d8-ab09-9cd97ebbf79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:55.566893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1146/2313] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:55.572100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f7b55-a429-4bf0-b1df-4f14b1933a50 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:55.581247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:52:55.585791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f7b55-a429-4bf0-b1df-4f14b1933a50 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:55.592273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebebd0-43eb-4b72-b634-81d1f02eeebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:55.593130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebebd0-43eb-4b72-b634-81d1f02eeebe admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.593587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebebd0-43eb-4b72-b634-81d1f02eeebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.593869 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebebd0-43eb-4b72-b634-81d1f02eeebe admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.594631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebebd0-43eb-4b72-b634-81d1f02eeebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:52:55.594940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebebd0-43eb-4b72-b634-81d1f02eeebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:55.597234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebebd0-43eb-4b72-b634-81d1f02eeebe admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:55.608883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1168/2314] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:52:55.613264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd2b0-dc9b-41d8-ab09-9cd97ebbf79a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:55.622809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd2b0-dc9b-41d8-ab09-9cd97ebbf79a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:55.627452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bf308-1db6-4821-b0c8-31fce08f9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:55.628095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bf308-1db6-4821-b0c8-31fce08f9c8d admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.628378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bf308-1db6-4821-b0c8-31fce08f9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.628656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bf308-1db6-4821-b0c8-31fce08f9c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.629342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bf308-1db6-4821-b0c8-31fce08f9c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:55.631287 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bf308-1db6-4821-b0c8-31fce08f9c8d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:55.656939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1147/2315] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:52:55 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:55.661816 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebebd0-43eb-4b72-b634-81d1f02eeebe admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:55.671695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebebd0-43eb-4b72-b634-81d1f02eeebe admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:55.731429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e645bce-37d5-414e-a6e1-214f0124f0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:55.732096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e645bce-37d5-414e-a6e1-214f0124f0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.732384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e645bce-37d5-414e-a6e1-214f0124f0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.732666 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e645bce-37d5-414e-a6e1-214f0124f0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.733491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e645bce-37d5-414e-a6e1-214f0124f0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:55.735456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e645bce-37d5-414e-a6e1-214f0124f0a3 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:55.756584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1169/2316] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:52:55 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:52:55.760758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bf308-1db6-4821-b0c8-31fce08f9c8d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:55.772450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bf308-1db6-4821-b0c8-31fce08f9c8d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:55.778100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc29fd9-f94e-4519-8961-653342f1d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:55.778799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc29fd9-f94e-4519-8961-653342f1d9da admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.779089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc29fd9-f94e-4519-8961-653342f1d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.779354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc29fd9-f94e-4519-8961-653342f1d9da admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.780077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc29fd9-f94e-4519-8961-653342f1d9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:55.781678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc29fd9-f94e-4519-8961-653342f1d9da admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:55.793686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1148/2317] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:52:55.797804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e645bce-37d5-414e-a6e1-214f0124f0a3 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:55.808505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e645bce-37d5-414e-a6e1-214f0124f0a3 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:55.813374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c0811-098f-4dda-aab7-4761f3f16202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:55.814798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c0811-098f-4dda-aab7-4761f3f16202 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.815101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c0811-098f-4dda-aab7-4761f3f16202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.815527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c0811-098f-4dda-aab7-4761f3f16202 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.816303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c0811-098f-4dda-aab7-4761f3f16202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:55.818015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c0811-098f-4dda-aab7-4761f3f16202 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:55.829339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1170/2318] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:52:55.834755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc29fd9-f94e-4519-8961-653342f1d9da admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:55.844733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc29fd9-f94e-4519-8961-653342f1d9da admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:55.850122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9aac-c3dc-4acb-bba2-4ff388693d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:55.851244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9aac-c3dc-4acb-bba2-4ff388693d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.851590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9aac-c3dc-4acb-bba2-4ff388693d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.851928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca9aac-c3dc-4acb-bba2-4ff388693d67 admin admin] PATH_INFO: `/v3/projects/79dbb107721b4406b5c3e2f5081034fd/users/10ae039c34c442f880c51aaf9024db8d/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.868561 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca9aac-c3dc-4acb-bba2-4ff388693d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79dbb107721b4406b5c3e2f5081034fd, user_id=10ae039c34c442f880c51aaf9024db8d, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:55.871349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca9aac-c3dc-4acb-bba2-4ff388693d67 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:55.885639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1149/2319] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:52:55 2022] PUT /identity/v3/projects/79dbb107721b4406b5c3e2f5081034fd/users/10ae039c34c442f880c51aaf9024db8d/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:52:55.890967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fea6a-fc21-41c2-bba4-f6d48bb01134 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:55.891353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fea6a-fc21-41c2-bba4-f6d48bb01134 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:55.891696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fea6a-fc21-41c2-bba4-f6d48bb01134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:55.910012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a56fea6a-fc21-41c2-bba4-f6d48bb01134 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:55.911327 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a56fea6a-fc21-41c2-bba4-f6d48bb01134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:55.970524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1171/2320] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:52:55.979936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9aac-c3dc-4acb-bba2-4ff388693d67 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:52:55.981658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-48ca9aac-c3dc-4acb-bba2-4ff388693d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:56.039216 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca9aac-c3dc-4acb-bba2-4ff388693d67 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:52:56.043012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5d175-ddb0-4122-9aa7-31c6e31693c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:52:56.043668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5d175-ddb0-4122-9aa7-31c6e31693c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:56.043955 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5d175-ddb0-4122-9aa7-31c6e31693c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:56.044238 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5d175-ddb0-4122-9aa7-31c6e31693c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:56.054389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5d175-ddb0-4122-9aa7-31c6e31693c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:52:56.055809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5d175-ddb0-4122-9aa7-31c6e31693c6 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:52:56.065624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1150/2321] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:52:56.074152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30285-a256-425c-817f-75d9b3a0b2da None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:52:56.074499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30285-a256-425c-817f-75d9b3a0b2da None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:52:56.074809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30285-a256-425c-817f-75d9b3a0b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:52:56.096195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-70b30285-a256-425c-817f-75d9b3a0b2da None None] MFA Rules not processed for user `9ba1d9d9fe3c4f93b5caa347997814b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:52:56.097809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-70b30285-a256-425c-817f-75d9b3a0b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:52:56.164965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1172/2322] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:00.582539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5d175-ddb0-4122-9aa7-31c6e31693c6 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:00.584184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-58c5d175-ddb0-4122-9aa7-31c6e31693c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:00.784962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:00.814229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5d175-ddb0-4122-9aa7-31c6e31693c6 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:00.821100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73eb1f-3804-4140-a187-891200719e9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:00.821465 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73eb1f-3804-4140-a187-891200719e9b service placement] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:00.821845 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73eb1f-3804-4140-a187-891200719e9b service placement] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:00.822241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73eb1f-3804-4140-a187-891200719e9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:00.824634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ba73eb1f-3804-4140-a187-891200719e9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:00.838250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73eb1f-3804-4140-a187-891200719e9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:00.840011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73eb1f-3804-4140-a187-891200719e9b service placement] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:00.854217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1151/2323] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:53:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:53:01.000242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3fb0e-0bb1-4beb-bf9c-5068b0b46c98 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:01.000811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3fb0e-0bb1-4beb-bf9c-5068b0b46c98 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:01.003186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3fb0e-0bb1-4beb-bf9c-5068b0b46c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:01.083416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0ef3fb0e-0bb1-4beb-bf9c-5068b0b46c98 None None] MFA Rules not processed for user `10ae039c34c442f880c51aaf9024db8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:01.094479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0ef3fb0e-0bb1-4beb-bf9c-5068b0b46c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:01.100494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:01.199412 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1173/2324] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:01.200430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73eb1f-3804-4140-a187-891200719e9b service placement] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:01.213481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73eb1f-3804-4140-a187-891200719e9b service placement] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:01.219509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d593bb-1aee-422c-b486-208e14997a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:01.220743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d593bb-1aee-422c-b486-208e14997a95 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:01.220743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d593bb-1aee-422c-b486-208e14997a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:01.221023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d593bb-1aee-422c-b486-208e14997a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:01.221720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d593bb-1aee-422c-b486-208e14997a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:01.224084 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d593bb-1aee-422c-b486-208e14997a95 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:01.272912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1152/2325] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:53:01 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:53:01.278056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3fb0e-0bb1-4beb-bf9c-5068b0b46c98 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:01.300217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3fb0e-0bb1-4beb-bf9c-5068b0b46c98 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:01.413661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a96e9b-e4af-40fe-8b53-932fa215dfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:01.414394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96e9b-e4af-40fe-8b53-932fa215dfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:01.414690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96e9b-e4af-40fe-8b53-932fa215dfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:01.414983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a96e9b-e4af-40fe-8b53-932fa215dfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:01.415694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a96e9b-e4af-40fe-8b53-932fa215dfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:01.417711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a96e9b-e4af-40fe-8b53-932fa215dfa0 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:01.445128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1174/2326] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:53:01 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:53:01.446336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d593bb-1aee-422c-b486-208e14997a95 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:01.458194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d593bb-1aee-422c-b486-208e14997a95 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:01.463478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ac732-96e9-4d88-b7e5-653ad00da2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:01.464314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ac732-96e9-4d88-b7e5-653ad00da2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:01.464613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ac732-96e9-4d88-b7e5-653ad00da2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:01.464895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ac732-96e9-4d88-b7e5-653ad00da2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:01.465795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ac732-96e9-4d88-b7e5-653ad00da2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:01.467474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ac732-96e9-4d88-b7e5-653ad00da2b2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:01.488619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1153/2327] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:53:01.493299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a96e9b-e4af-40fe-8b53-932fa215dfa0 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:01.505143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a96e9b-e4af-40fe-8b53-932fa215dfa0 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:01.510804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b56a99-7bd2-47b6-9441-28f3a24ed27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:01.511803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b56a99-7bd2-47b6-9441-28f3a24ed27c admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:01.512076 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b56a99-7bd2-47b6-9441-28f3a24ed27c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:01.512413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b56a99-7bd2-47b6-9441-28f3a24ed27c admin admin] PATH_INFO: `/v3/projects/67d8230adaba4186b21de3a7853b883f/users/11cfca6196fe4cc7a0138b6682c69922/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:01.538841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b56a99-7bd2-47b6-9441-28f3a24ed27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d8230adaba4186b21de3a7853b883f, user_id=11cfca6196fe4cc7a0138b6682c69922, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:01.541567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b56a99-7bd2-47b6-9441-28f3a24ed27c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:01.564762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1175/2328] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:53:01 2022] PUT /identity/v3/projects/67d8230adaba4186b21de3a7853b883f/users/11cfca6196fe4cc7a0138b6682c69922/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:53:01.568722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ac732-96e9-4d88-b7e5-653ad00da2b2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:01.584564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ac732-96e9-4d88-b7e5-653ad00da2b2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:01.760371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07256818-46d5-4d5c-98d0-3604abfe6502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:01.761244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07256818-46d5-4d5c-98d0-3604abfe6502 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:01.762945 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07256818-46d5-4d5c-98d0-3604abfe6502 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:01.763333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07256818-46d5-4d5c-98d0-3604abfe6502 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:01.764533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07256818-46d5-4d5c-98d0-3604abfe6502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:01.771722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07256818-46d5-4d5c-98d0-3604abfe6502 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:01.808615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b56a99-7bd2-47b6-9441-28f3a24ed27c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:01.808832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1154/2329] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:53:01.831176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b56a99-7bd2-47b6-9441-28f3a24ed27c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:01.837075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040bb01-c259-4ddc-8c27-7e068f16cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:01.838003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040bb01-c259-4ddc-8c27-7e068f16cf21 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:01.838365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040bb01-c259-4ddc-8c27-7e068f16cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:01.838652 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040bb01-c259-4ddc-8c27-7e068f16cf21 admin admin] PATH_INFO: `/v3/projects/67d8230adaba4186b21de3a7853b883f/users/11cfca6196fe4cc7a0138b6682c69922/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:01.841165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040bb01-c259-4ddc-8c27-7e068f16cf21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d8230adaba4186b21de3a7853b883f, user_id=11cfca6196fe4cc7a0138b6682c69922, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:01.844214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040bb01-c259-4ddc-8c27-7e068f16cf21 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:01.884995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1176/2330] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:53:01 2022] PUT /identity/v3/projects/67d8230adaba4186b21de3a7853b883f/users/11cfca6196fe4cc7a0138b6682c69922/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:53:07.988080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8113-b79d-4066-ad90-477493414ff8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:07.988626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8113-b79d-4066-ad90-477493414ff8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:07.988759 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad8113-b79d-4066-ad90-477493414ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:08.051246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-54ad8113-b79d-4066-ad90-477493414ff8 None None] MFA Rules not processed for user `11cfca6196fe4cc7a0138b6682c69922`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:08.052506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-54ad8113-b79d-4066-ad90-477493414ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:08.187800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1155/2331] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:53:08.202069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040bb01-c259-4ddc-8c27-7e068f16cf21 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:08.207048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b040bb01-c259-4ddc-8c27-7e068f16cf21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:08.285744 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:08.338650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040bb01-c259-4ddc-8c27-7e068f16cf21 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:08.346914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd70559-2db3-412f-886a-567da1f1a158 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:08.347493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd70559-2db3-412f-886a-567da1f1a158 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:08.347933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd70559-2db3-412f-886a-567da1f1a158 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:08.348315 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd70559-2db3-412f-886a-567da1f1a158 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:08.420391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd70559-2db3-412f-886a-567da1f1a158 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:08.422183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd70559-2db3-412f-886a-567da1f1a158 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:08.432573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1177/2332] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:53:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:53:09.469389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a42b-8303-4505-b800-6f89f317bcc4 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:09.471137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a42b-8303-4505-b800-6f89f317bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:09.471137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86a42b-8303-4505-b800-6f89f317bcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:09.492303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7d86a42b-8303-4505-b800-6f89f317bcc4 None None] MFA Rules not processed for user `d230950f9e984a8b878d7d0f74dda3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:09.493774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7d86a42b-8303-4505-b800-6f89f317bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:09.543624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:09.588071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1156/2333] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:18.004105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd70559-2db3-412f-886a-567da1f1a158 service nova] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:18.005568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-fbd70559-2db3-412f-886a-567da1f1a158 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:18.073616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd70559-2db3-412f-886a-567da1f1a158 service nova] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:18.078494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:18.079497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:18.079778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:18.080054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] PATH_INFO: `/v3/users/7b52822ac11046a89e37089e71a7a51e` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:18.081248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b52822ac11046a89e37089e71a7a51e)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:18.083217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:18.130821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b52822ac11046a89e37089e71a7a51e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.131477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b52822ac11046a89e37089e71a7a51e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.132082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b52822ac11046a89e37089e71a7a51e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.144626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b52822ac11046a89e37089e71a7a51e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.148930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:18.153302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b52822ac11046a89e37089e71a7a51e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.168085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1178/2334] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:53:18 2022] DELETE /identity/v3/users/7b52822ac11046a89e37089e71a7a51e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:53:18.173453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f02371-6838-4b5f-923b-d1fcb1186670 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:18.174391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f02371-6838-4b5f-923b-d1fcb1186670 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:18.174685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f02371-6838-4b5f-923b-d1fcb1186670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:18.192555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a5f02371-6838-4b5f-923b-d1fcb1186670 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:18.193760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a5f02371-6838-4b5f-923b-d1fcb1186670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:18.258648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1157/2335] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:18.268487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:18.269925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:18.331166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59abfa-241c-4a6e-88fa-a346a22f32d4 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:18.335321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d020245-a465-4178-b274-f31dc128dc0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:18.335980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020245-a465-4178-b274-f31dc128dc0b service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:18.336266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020245-a465-4178-b274-f31dc128dc0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:18.336544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020245-a465-4178-b274-f31dc128dc0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:18.346891 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d020245-a465-4178-b274-f31dc128dc0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:18.348319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d020245-a465-4178-b274-f31dc128dc0b service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:18.357937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1179/2336] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:53:18.686471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f02371-6838-4b5f-923b-d1fcb1186670 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:18.688503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a5f02371-6838-4b5f-923b-d1fcb1186670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:18.718841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f02371-6838-4b5f-923b-d1fcb1186670 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:18.726400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:18.728090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:18.728448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:18.728797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] PATH_INFO: `/v3/projects/4071f0e376a64f69a43d5ae6c871e15d` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:18.730092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4071f0e376a64f69a43d5ae6c871e15d)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:18.732182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:18.796352 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4071f0e376a64f69a43d5ae6c871e15d', 'request_id': 'req-81aea21d-6d95-45f3-a27a-3c431cd74f07'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.804500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4071f0e376a64f69a43d5ae6c871e15d', 'request_id': 'req-81aea21d-6d95-45f3-a27a-3c431cd74f07'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.811179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4071f0e376a64f69a43d5ae6c871e15d', 'request_id': 'req-81aea21d-6d95-45f3-a27a-3c431cd74f07'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.821892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] The token cache is being invalidate because project 4071f0e376a64f69a43d5ae6c871e15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:53:18.822231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.823277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-81aea21d-6d95-45f3-a27a-3c431cd74f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:18.827635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1158/2337] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:53:18 2022] DELETE /identity/v3/projects/4071f0e376a64f69a43d5ae6c871e15d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:53:18.831133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42671774-fa5f-46a7-85b4-e5d050570ce1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:18.831431 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42671774-fa5f-46a7-85b4-e5d050570ce1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:18.831743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42671774-fa5f-46a7-85b4-e5d050570ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:18.849636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-42671774-fa5f-46a7-85b4-e5d050570ce1 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:18.850887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-42671774-fa5f-46a7-85b4-e5d050570ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:18.913913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1180/2338] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:18.921626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075abc-9217-461c-a879-b2714cc7273a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:18.921911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075abc-9217-461c-a879-b2714cc7273a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:18.922191 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36075abc-9217-461c-a879-b2714cc7273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:18.943749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-36075abc-9217-461c-a879-b2714cc7273a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:18.944970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-36075abc-9217-461c-a879-b2714cc7273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:18.953509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1159/2339] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:18.958465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42671774-fa5f-46a7-85b4-e5d050570ce1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:18.974820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42671774-fa5f-46a7-85b4-e5d050570ce1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:18.979662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3ca8-b9c5-44c6-9d7e-79b27f40c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:18.980511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3ca8-b9c5-44c6-9d7e-79b27f40c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:18.980885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3ca8-b9c5-44c6-9d7e-79b27f40c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:18.981227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd3ca8-b9c5-44c6-9d7e-79b27f40c6fb admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:18.982152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3ca8-b9c5-44c6-9d7e-79b27f40c6fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:18.990207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3ca8-b9c5-44c6-9d7e-79b27f40c6fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:18.990207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd3ca8-b9c5-44c6-9d7e-79b27f40c6fb admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:19.000501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1181/2340] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:19.005434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36075abc-9217-461c-a879-b2714cc7273a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:19.014892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36075abc-9217-461c-a879-b2714cc7273a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:19.019860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed9bf0-083d-4fb1-8f72-7d161369ca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:19.020452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed9bf0-083d-4fb1-8f72-7d161369ca7e admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:19.020737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed9bf0-083d-4fb1-8f72-7d161369ca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:19.021011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed9bf0-083d-4fb1-8f72-7d161369ca7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:19.021711 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed9bf0-083d-4fb1-8f72-7d161369ca7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:19.023917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed9bf0-083d-4fb1-8f72-7d161369ca7e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:19.054822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1160/2341] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:53:19 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:53:19.060942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3ca8-b9c5-44c6-9d7e-79b27f40c6fb admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:19.072555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd3ca8-b9c5-44c6-9d7e-79b27f40c6fb admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:19.147766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc16228-414f-4485-aecf-847344953093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:19.148687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc16228-414f-4485-aecf-847344953093 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:19.149101 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc16228-414f-4485-aecf-847344953093 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:19.149446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc16228-414f-4485-aecf-847344953093 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:19.150480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc16228-414f-4485-aecf-847344953093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:19.153546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc16228-414f-4485-aecf-847344953093 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:19.187778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1182/2342] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:53:19 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:53:19.189520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed9bf0-083d-4fb1-8f72-7d161369ca7e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:19.207557 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed9bf0-083d-4fb1-8f72-7d161369ca7e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:19.213104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32818d-8759-4a06-8024-456ad35810df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:19.213969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32818d-8759-4a06-8024-456ad35810df admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:19.214520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32818d-8759-4a06-8024-456ad35810df admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:19.215020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32818d-8759-4a06-8024-456ad35810df admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:19.215958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32818d-8759-4a06-8024-456ad35810df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:19.217763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32818d-8759-4a06-8024-456ad35810df admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:19.231041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1161/2343] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:53:19.237397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc16228-414f-4485-aecf-847344953093 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:19.253787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc16228-414f-4485-aecf-847344953093 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:19.262797 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d699-d40f-4754-84d4-b6dc84ff0955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:19.263932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d699-d40f-4754-84d4-b6dc84ff0955 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:19.264425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d699-d40f-4754-84d4-b6dc84ff0955 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:19.264764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d699-d40f-4754-84d4-b6dc84ff0955 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:19.265572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771d699-d40f-4754-84d4-b6dc84ff0955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:19.268484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771d699-d40f-4754-84d4-b6dc84ff0955 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:19.271094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:19.287202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1183/2344] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:53:19.288689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32818d-8759-4a06-8024-456ad35810df admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:19.311021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32818d-8759-4a06-8024-456ad35810df admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:19.322479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e06db2-080b-459e-acf4-94135f4ea55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:19.328650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e06db2-080b-459e-acf4-94135f4ea55d admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:19.331057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e06db2-080b-459e-acf4-94135f4ea55d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:19.331569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e06db2-080b-459e-acf4-94135f4ea55d admin admin] PATH_INFO: `/v3/projects/239b2eb649884802b59347962a7bfa88/users/c1b116b882c141f29eef749cd9a8a5ea/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:19.350747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e06db2-080b-459e-acf4-94135f4ea55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=239b2eb649884802b59347962a7bfa88, user_id=c1b116b882c141f29eef749cd9a8a5ea, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:19.353397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e06db2-080b-459e-acf4-94135f4ea55d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:19.355687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:19.372972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1162/2345] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:53:19 2022] PUT /identity/v3/projects/239b2eb649884802b59347962a7bfa88/users/c1b116b882c141f29eef749cd9a8a5ea/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:53:19.385684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852a199-81cc-4e55-b6bf-dcdc5ca42220 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:19.386285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852a199-81cc-4e55-b6bf-dcdc5ca42220 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:19.386624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852a199-81cc-4e55-b6bf-dcdc5ca42220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:19.424540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c852a199-81cc-4e55-b6bf-dcdc5ca42220 None None] MFA Rules not processed for user `c1b116b882c141f29eef749cd9a8a5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:19.425939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c852a199-81cc-4e55-b6bf-dcdc5ca42220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:19.497912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1184/2346] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:19.509102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e06db2-080b-459e-acf4-94135f4ea55d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:19.511111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d0e06db2-080b-459e-acf4-94135f4ea55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:19.608693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e06db2-080b-459e-acf4-94135f4ea55d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:19.613335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c99922-9987-4be8-8452-cfec6ee5f114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:19.613984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99922-9987-4be8-8452-cfec6ee5f114 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:19.614269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99922-9987-4be8-8452-cfec6ee5f114 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:19.614578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c99922-9987-4be8-8452-cfec6ee5f114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:19.623718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c99922-9987-4be8-8452-cfec6ee5f114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:19.625184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c99922-9987-4be8-8452-cfec6ee5f114 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:19.636748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1163/2347] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:53:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:53:22.104606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f06250-c9f4-4b30-aacf-68244d1b4c13 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:22.105188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f06250-c9f4-4b30-aacf-68244d1b4c13 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:22.105690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f06250-c9f4-4b30-aacf-68244d1b4c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:22.123803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-71f06250-c9f4-4b30-aacf-68244d1b4c13 None None] MFA Rules not processed for user `c1b116b882c141f29eef749cd9a8a5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:22.125033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-71f06250-c9f4-4b30-aacf-68244d1b4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:22.132592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1185/2348] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:29.631738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:INSERT=1,keystone:SELECT=37 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:32.118106 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=37 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:36.721212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836903-50ef-454d-a620-65d924d3aa52 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:36.722275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836903-50ef-454d-a620-65d924d3aa52 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:36.722418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc836903-50ef-454d-a620-65d924d3aa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:36.740676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-fc836903-50ef-454d-a620-65d924d3aa52 None None] MFA Rules not processed for user `10ae039c34c442f880c51aaf9024db8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:36.741888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-fc836903-50ef-454d-a620-65d924d3aa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:36.798560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1164/2349] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:37.672645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f06250-c9f4-4b30-aacf-68244d1b4c13 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:37.674208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-71f06250-c9f4-4b30-aacf-68244d1b4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:37.755395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f06250-c9f4-4b30-aacf-68244d1b4c13 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:37.759471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f4679-4006-4059-96d7-95efd3436810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:37.760240 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f4679-4006-4059-96d7-95efd3436810 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:37.760594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f4679-4006-4059-96d7-95efd3436810 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:37.760980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f4679-4006-4059-96d7-95efd3436810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:37.763111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-190f4679-4006-4059-96d7-95efd3436810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:37.841896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f4679-4006-4059-96d7-95efd3436810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:37.843381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f4679-4006-4059-96d7-95efd3436810 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:37.854928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1186/2350] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:53:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:53:38.354293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b620759-2712-45ab-8c52-e699a696cb43 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:38.354927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b620759-2712-45ab-8c52-e699a696cb43 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:38.355025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b620759-2712-45ab-8c52-e699a696cb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:38.377411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7b620759-2712-45ab-8c52-e699a696cb43 None None] MFA Rules not processed for user `9ba1d9d9fe3c4f93b5caa347997814b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:38.379609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7b620759-2712-45ab-8c52-e699a696cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:38.449166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1165/2351] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:46.345064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab19b15-9cb8-49b2-a562-5469d7667541 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:46.345654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab19b15-9cb8-49b2-a562-5469d7667541 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:46.345654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab19b15-9cb8-49b2-a562-5469d7667541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:46.400442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-dab19b15-9cb8-49b2-a562-5469d7667541 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:46.401691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-dab19b15-9cb8-49b2-a562-5469d7667541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:46.472919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1187/2352] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:46.515085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b620759-2712-45ab-8c52-e699a696cb43 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:46.516583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7b620759-2712-45ab-8c52-e699a696cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:46.635763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b620759-2712-45ab-8c52-e699a696cb43 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:46.646272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e86c53-6127-401f-840e-6db33dda6a16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:46.646976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e86c53-6127-401f-840e-6db33dda6a16 service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:46.647267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e86c53-6127-401f-840e-6db33dda6a16 service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:46.647552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e86c53-6127-401f-840e-6db33dda6a16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:46.657666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e86c53-6127-401f-840e-6db33dda6a16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:46.660101 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e86c53-6127-401f-840e-6db33dda6a16 service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:46.673358 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1166/2353] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:53:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:53:47.341020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74d340-cbe0-42d9-b4dc-b5c5315bba0e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:47.341410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74d340-cbe0-42d9-b4dc-b5c5315bba0e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:47.341760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74d340-cbe0-42d9-b4dc-b5c5315bba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:47.360610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-4a74d340-cbe0-42d9-b4dc-b5c5315bba0e None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:47.361863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4a74d340-cbe0-42d9-b4dc-b5c5315bba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:47.369171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1188/2354] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 23 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:47.383041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e86c53-6127-401f-840e-6db33dda6a16 service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:47.394100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e86c53-6127-401f-840e-6db33dda6a16 service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:47.399052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37754c1-3937-4d09-b3b4-581a227183de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:47.399675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37754c1-3937-4d09-b3b4-581a227183de service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:47.399956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37754c1-3937-4d09-b3b4-581a227183de service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:47.400230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37754c1-3937-4d09-b3b4-581a227183de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:47.408208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37754c1-3937-4d09-b3b4-581a227183de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:47.409938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37754c1-3937-4d09-b3b4-581a227183de service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:47.417873 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1167/2355] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:53:47.612419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9334cd-5b5d-4380-b199-d42a1ef436b4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:47.612705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9334cd-5b5d-4380-b199-d42a1ef436b4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:47.613130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9334cd-5b5d-4380-b199-d42a1ef436b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:47.630596 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0d9334cd-5b5d-4380-b199-d42a1ef436b4 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:47.631798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0d9334cd-5b5d-4380-b199-d42a1ef436b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:47.638982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1189/2356] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:53:47.651066 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37754c1-3937-4d09-b3b4-581a227183de service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:47.664108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37754c1-3937-4d09-b3b4-581a227183de service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:47.669361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240abe-0a87-435f-bc12-16bc3a569e8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:47.669991 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240abe-0a87-435f-bc12-16bc3a569e8a service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:47.670274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240abe-0a87-435f-bc12-16bc3a569e8a service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:47.670579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a240abe-0a87-435f-bc12-16bc3a569e8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:47.676100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:47.680716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240abe-0a87-435f-bc12-16bc3a569e8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:47.682562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a240abe-0a87-435f-bc12-16bc3a569e8a service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:47.691658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1168/2357] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:53:48.026015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e904e8-5525-4531-b2d3-1ec8eab384c6 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:48.026305 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e904e8-5525-4531-b2d3-1ec8eab384c6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:48.026616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e904e8-5525-4531-b2d3-1ec8eab384c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:48.044799 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-05e904e8-5525-4531-b2d3-1ec8eab384c6 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:48.045691 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-05e904e8-5525-4531-b2d3-1ec8eab384c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:48.053951 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1190/2358] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 23 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:48.066934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240abe-0a87-435f-bc12-16bc3a569e8a service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:48.078488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a240abe-0a87-435f-bc12-16bc3a569e8a service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:48.083669 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac370b-9b9a-424d-a69f-4d865d7c61a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:48.084309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac370b-9b9a-424d-a69f-4d865d7c61a1 service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:48.084595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac370b-9b9a-424d-a69f-4d865d7c61a1 service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:48.084877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac370b-9b9a-424d-a69f-4d865d7c61a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:48.093625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac370b-9b9a-424d-a69f-4d865d7c61a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:48.095549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac370b-9b9a-424d-a69f-4d865d7c61a1 service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:48.106259 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1169/2359] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:53:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:53:50.288276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e904e8-5525-4531-b2d3-1ec8eab384c6 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:50.293897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:50.356238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e904e8-5525-4531-b2d3-1ec8eab384c6 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:50.361464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:50.363027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:50.363393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:50.363731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] PATH_INFO: `/v3/users/c1b116b882c141f29eef749cd9a8a5ea` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:50.365040 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b116b882c141f29eef749cd9a8a5ea)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:50.367021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:50.417027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b116b882c141f29eef749cd9a8a5ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.417611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b116b882c141f29eef749cd9a8a5ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.418215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b116b882c141f29eef749cd9a8a5ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.431020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b116b882c141f29eef749cd9a8a5ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.437830 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b116b882c141f29eef749cd9a8a5ea'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.451261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1191/2360] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:53:50 2022] DELETE /identity/v3/users/c1b116b882c141f29eef749cd9a8a5ea => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:53:50.455694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fab356-499a-4d82-8862-63d761fa7a66 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:50.456250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fab356-499a-4d82-8862-63d761fa7a66 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:50.456250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fab356-499a-4d82-8862-63d761fa7a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:50.474156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f3fab356-499a-4d82-8862-63d761fa7a66 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:50.475391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f3fab356-499a-4d82-8862-63d761fa7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:50.536024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1170/2361] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:53:50.545576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:50.546993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:50.604152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060ddc4-72dc-45a4-84b2-cbaea5feea4f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:50.607814 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a97fb-30d6-4a06-bd79-f42869b86847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:50.608450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a97fb-30d6-4a06-bd79-f42869b86847 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:50.608734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a97fb-30d6-4a06-bd79-f42869b86847 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:50.609013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a97fb-30d6-4a06-bd79-f42869b86847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:50.618697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a97fb-30d6-4a06-bd79-f42869b86847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:50.620110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a97fb-30d6-4a06-bd79-f42869b86847 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:50.630138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1192/2362] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:53:50.803511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fab356-499a-4d82-8862-63d761fa7a66 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:50.804961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f3fab356-499a-4d82-8862-63d761fa7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:50.818524 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fab356-499a-4d82-8862-63d761fa7a66 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:50.823404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:50.824519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:50.824801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:50.825647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] PATH_INFO: `/v3/projects/239b2eb649884802b59347962a7bfa88` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:50.827051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239b2eb649884802b59347962a7bfa88)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:50.828981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:50.878680 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239b2eb649884802b59347962a7bfa88', 'request_id': 'req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.886171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239b2eb649884802b59347962a7bfa88', 'request_id': 'req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.892943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239b2eb649884802b59347962a7bfa88', 'request_id': 'req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.904413 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] The token cache is being invalidate because project 239b2eb649884802b59347962a7bfa88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:53:50.904730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.905355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:53:50.906910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1171/2363] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:53:50 2022] DELETE /identity/v3/projects/239b2eb649884802b59347962a7bfa88 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:54:00.545880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c2f6c-5da5-4ba1-a825-d6e3a74b61d4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:00.546381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c2f6c-5da5-4ba1-a825-d6e3a74b61d4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:00.546505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c2f6c-5da5-4ba1-a825-d6e3a74b61d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:00.570962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-3a4c2f6c-5da5-4ba1-a825-d6e3a74b61d4 None None] MFA Rules not processed for user `eb8df5670686403480cdfd32ac408945`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:00.572539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3a4c2f6c-5da5-4ba1-a825-d6e3a74b61d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:00.597766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:00.640462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1193/2364] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:00.901328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:03.909237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:03.911225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:03.989157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcefcd-d0b9-4406-be9a-c698e2ed8969 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:03.993729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:03.994518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:03.994839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:03.995122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:03.997207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:04.081603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:04.083209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:04.094570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1172/2365] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:54:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:54:10.633713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=14 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:10.905186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f14a02-7b51-4cfa-904b-953c7b3f9cf5 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:10.905476 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f14a02-7b51-4cfa-904b-953c7b3f9cf5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:10.905759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f14a02-7b51-4cfa-904b-953c7b3f9cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:10.924631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-70f14a02-7b51-4cfa-904b-953c7b3f9cf5 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:10.925875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-70f14a02-7b51-4cfa-904b-953c7b3f9cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:10.982976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1194/2366] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:10.995375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:10.997276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:11.079454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4c17d-224b-46db-b06e-b896ac17c993 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:11.084658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e5f48-b27b-4fc2-aae1-51776a8c026b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:11.085307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e5f48-b27b-4fc2-aae1-51776a8c026b service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:11.085593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e5f48-b27b-4fc2-aae1-51776a8c026b service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:11.085870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e5f48-b27b-4fc2-aae1-51776a8c026b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:11.095142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e5f48-b27b-4fc2-aae1-51776a8c026b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:11.097288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e5f48-b27b-4fc2-aae1-51776a8c026b service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:11.106398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1173/2367] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:54:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:54:20.976299 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=25 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:21.103247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=82 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:25.325309 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3662c-a2ad-4704-aa81-768c2279f212 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:25.325861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3662c-a2ad-4704-aa81-768c2279f212 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:25.325861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3662c-a2ad-4704-aa81-768c2279f212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:25.350719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-01f3662c-a2ad-4704-aa81-768c2279f212 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:25.352042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-01f3662c-a2ad-4704-aa81-768c2279f212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:25.360064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1195/2368] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:25.380635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e5f48-b27b-4fc2-aae1-51776a8c026b service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:25.395220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e5f48-b27b-4fc2-aae1-51776a8c026b service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:25.400623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8735d44-78a6-49e1-9e3f-93094bdbb21d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:25.401267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8735d44-78a6-49e1-9e3f-93094bdbb21d service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:25.401558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8735d44-78a6-49e1-9e3f-93094bdbb21d service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:25.401831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8735d44-78a6-49e1-9e3f-93094bdbb21d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:25.416448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8735d44-78a6-49e1-9e3f-93094bdbb21d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:25.418270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8735d44-78a6-49e1-9e3f-93094bdbb21d service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:25.428247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1174/2369] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:54:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 10:54:27.216287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab698c-c89f-4602-8cfd-240cefe60b66 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:27.217876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab698c-c89f-4602-8cfd-240cefe60b66 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:27.218417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab698c-c89f-4602-8cfd-240cefe60b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:27.239416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-f3ab698c-c89f-4602-8cfd-240cefe60b66 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:27.240945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f3ab698c-c89f-4602-8cfd-240cefe60b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:27.249321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1196/2370] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 23 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:27.263152 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8735d44-78a6-49e1-9e3f-93094bdbb21d service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:27.274307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8735d44-78a6-49e1-9e3f-93094bdbb21d service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:27.280079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b14158-fef2-4089-8c73-21b810829922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:27.280974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b14158-fef2-4089-8c73-21b810829922 service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:27.281331 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b14158-fef2-4089-8c73-21b810829922 service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:27.281681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b14158-fef2-4089-8c73-21b810829922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:27.293731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b14158-fef2-4089-8c73-21b810829922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:27.295402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b14158-fef2-4089-8c73-21b810829922 service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:27.306060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1175/2371] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:54:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:54:29.488191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab698c-c89f-4602-8cfd-240cefe60b66 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:29.492634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f3ab698c-c89f-4602-8cfd-240cefe60b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:29.641283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab698c-c89f-4602-8cfd-240cefe60b66 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:29.646638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:29.647875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:29.648374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:29.648850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] PATH_INFO: `/v3/users/9ba1d9d9fe3c4f93b5caa347997814b2` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:29.650425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba1d9d9fe3c4f93b5caa347997814b2)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:29.653174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:29.753898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba1d9d9fe3c4f93b5caa347997814b2'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:29.754933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba1d9d9fe3c4f93b5caa347997814b2'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:29.755865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba1d9d9fe3c4f93b5caa347997814b2'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:29.782427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba1d9d9fe3c4f93b5caa347997814b2'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:29.786337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-481ecbe1-31d9-45df-9165-18e380c431c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba1d9d9fe3c4f93b5caa347997814b2'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:29.806111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1197/2372] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:54:29 2022] DELETE /identity/v3/users/9ba1d9d9fe3c4f93b5caa347997814b2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:54:29.992420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b14158-fef2-4089-8c73-21b810829922 service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:30.004986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b14158-fef2-4089-8c73-21b810829922 service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:30.070624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:30.071485 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:30.071767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:30.072046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] PATH_INFO: `/v3/projects/33d03af3f8904c829e5a04755f7e3c1b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:30.073240 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d03af3f8904c829e5a04755f7e3c1b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:30.075472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:30.125905 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d03af3f8904c829e5a04755f7e3c1b', 'request_id': 'req-a5fe9cee-8a4f-43ce-9504-6011786f13e1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:30.137313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d03af3f8904c829e5a04755f7e3c1b', 'request_id': 'req-a5fe9cee-8a4f-43ce-9504-6011786f13e1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:30.147387 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d03af3f8904c829e5a04755f7e3c1b', 'request_id': 'req-a5fe9cee-8a4f-43ce-9504-6011786f13e1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:30.158758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] The token cache is being invalidate because project 33d03af3f8904c829e5a04755f7e3c1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:54:30.159207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:30.161303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a5fe9cee-8a4f-43ce-9504-6011786f13e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:54:30.163075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1176/2373] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:54:29 2022] DELETE /identity/v3/projects/33d03af3f8904c829e5a04755f7e3c1b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:54:39.788929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e00f7-ca5d-435b-b35a-ada766f9390e None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:39.789464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e00f7-ca5d-435b-b35a-ada766f9390e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:39.789464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e00f7-ca5d-435b-b35a-ada766f9390e None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:39.790893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1198/2374] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:54:39.796968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb96d96-0e10-4c87-963e-d7b3f6b34268 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:39.797431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb96d96-0e10-4c87-963e-d7b3f6b34268 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:39.797660 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:39.797762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb96d96-0e10-4c87-963e-d7b3f6b34268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:39.840139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8eb96d96-0e10-4c87-963e-d7b3f6b34268 None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:39.841376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8eb96d96-0e10-4c87-963e-d7b3f6b34268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:39.890579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:39.925270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1177/2375] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:39.928208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e00f7-ca5d-435b-b35a-ada766f9390e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:39.929899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d79e00f7-ca5d-435b-b35a-ada766f9390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:40.009312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e00f7-ca5d-435b-b35a-ada766f9390e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:40.012871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e5a5dd-14fe-417b-9967-2a5036c44804 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33a1696d1cc14ca6ac1cb970598f11fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:40.013508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5a5dd-14fe-417b-9967-2a5036c44804 service glance] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:40.013790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5a5dd-14fe-417b-9967-2a5036c44804 service glance] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:40.014066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5a5dd-14fe-417b-9967-2a5036c44804 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:40.024159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5a5dd-14fe-417b-9967-2a5036c44804 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:40.025574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e5a5dd-14fe-417b-9967-2a5036c44804 service glance] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:40.036117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1199/2376] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:54:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:54:40.101754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3779-9915-4692-82cc-5c14b95b05e3 None None] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:40.102067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3779-9915-4692-82cc-5c14b95b05e3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:40.102399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3779-9915-4692-82cc-5c14b95b05e3 None None] PATH_INFO: `/` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:40.103788 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1178/2377] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:54:40.108621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f89f-4487-4a47-b469-490c90fa4f5a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:40.108966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f89f-4487-4a47-b469-490c90fa4f5a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:40.109255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65f89f-4487-4a47-b469-490c90fa4f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:40.128610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-3c65f89f-4487-4a47-b469-490c90fa4f5a None None] MFA Rules not processed for user `ed8f21a950d6483abc7ab67fb533942a`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:40.129813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3c65f89f-4487-4a47-b469-490c90fa4f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:40.182055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1200/2378] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:40.194134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3779-9915-4692-82cc-5c14b95b05e3 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:40.195839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-558a3779-9915-4692-82cc-5c14b95b05e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:40.209745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3779-9915-4692-82cc-5c14b95b05e3 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:40.214057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836e00d-d0b7-4806-b89c-1eb631d27141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:40.214739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e00d-d0b7-4806-b89c-1eb631d27141 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:40.215049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e00d-d0b7-4806-b89c-1eb631d27141 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:40.215331 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836e00d-d0b7-4806-b89c-1eb631d27141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:40.223404 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836e00d-d0b7-4806-b89c-1eb631d27141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:40.224834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836e00d-d0b7-4806-b89c-1eb631d27141 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:40.232595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1179/2379] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:54:40.318380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6672d2d-1102-4b4a-a3d4-8e1862fe8c34 None None] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:40.318681 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6672d2d-1102-4b4a-a3d4-8e1862fe8c34 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:40.318996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6672d2d-1102-4b4a-a3d4-8e1862fe8c34 None None] PATH_INFO: `/` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:40.320402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1201/2380] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jun 23 10:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:54:40.325550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012164c-d19a-4f9c-a940-14719b024c88 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:40.325839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012164c-d19a-4f9c-a940-14719b024c88 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:40.326118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012164c-d19a-4f9c-a940-14719b024c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:40.346554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f012164c-d19a-4f9c-a940-14719b024c88 None None] MFA Rules not processed for user `0d639e845cfa4f10b8e86cd237664c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:40.347758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f012164c-d19a-4f9c-a940-14719b024c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:40.356912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1180/2381] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jun 23 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:40.367482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6672d2d-1102-4b4a-a3d4-8e1862fe8c34 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:40.379323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6672d2d-1102-4b4a-a3d4-8e1862fe8c34 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:40.383024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cafe9f-0c03-4776-9ac8-2c3156d4572e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:40.383653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cafe9f-0c03-4776-9ac8-2c3156d4572e service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:40.384080 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cafe9f-0c03-4776-9ac8-2c3156d4572e service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:40.384362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cafe9f-0c03-4776-9ac8-2c3156d4572e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:40.395165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cafe9f-0c03-4776-9ac8-2c3156d4572e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:40.396578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cafe9f-0c03-4776-9ac8-2c3156d4572e service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:40.407034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1202/2382] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:54:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:54:42.792573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50433a3-b9f0-4734-a619-53ac4d617ade None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:42.793039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50433a3-b9f0-4734-a619-53ac4d617ade None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:42.793132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50433a3-b9f0-4734-a619-53ac4d617ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:42.810827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f50433a3-b9f0-4734-a619-53ac4d617ade None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:54:42.812339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f50433a3-b9f0-4734-a619-53ac4d617ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:42.868049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1181/2383] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:54:42.879761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cafe9f-0c03-4776-9ac8-2c3156d4572e service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:42.881154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-70cafe9f-0c03-4776-9ac8-2c3156d4572e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:42.952209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cafe9f-0c03-4776-9ac8-2c3156d4572e service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:42.957516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5fb82-657b-4af6-a8c0-89ffe8bd7fef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:42.958157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5fb82-657b-4af6-a8c0-89ffe8bd7fef service swift] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:42.958485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5fb82-657b-4af6-a8c0-89ffe8bd7fef service swift] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:42.958768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5fb82-657b-4af6-a8c0-89ffe8bd7fef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:42.966878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5fb82-657b-4af6-a8c0-89ffe8bd7fef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:42.968465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5fb82-657b-4af6-a8c0-89ffe8bd7fef service swift] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:42.976871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1203/2384] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:54:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:54:52.787213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50433a3-b9f0-4734-a619-53ac4d617ade None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:52.788756 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f50433a3-b9f0-4734-a619-53ac4d617ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:52.800866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50433a3-b9f0-4734-a619-53ac4d617ade None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:52.804376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03679a-766b-48b6-a0ec-4451adae181c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:52.805013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03679a-766b-48b6-a0ec-4451adae181c service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:52.805300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03679a-766b-48b6-a0ec-4451adae181c service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:52.805582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03679a-766b-48b6-a0ec-4451adae181c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:52.807349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ee03679a-766b-48b6-a0ec-4451adae181c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:52.823434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03679a-766b-48b6-a0ec-4451adae181c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:52.825439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03679a-766b-48b6-a0ec-4451adae181c service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:52.837931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1182/2385] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:54:52.973661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:54:54.021274 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5fb82-657b-4af6-a8c0-89ffe8bd7fef service swift] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:54:54.032073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5fb82-657b-4af6-a8c0-89ffe8bd7fef service swift] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:54:54.036935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7694b56-a498-4d00-9bba-cbbffa1c117d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:54:54.037696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7694b56-a498-4d00-9bba-cbbffa1c117d service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:54:54.037983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7694b56-a498-4d00-9bba-cbbffa1c117d service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:54:54.038259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7694b56-a498-4d00-9bba-cbbffa1c117d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:54:54.040057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e7694b56-a498-4d00-9bba-cbbffa1c117d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:54:54.053734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7694b56-a498-4d00-9bba-cbbffa1c117d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:54:54.055224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7694b56-a498-4d00-9bba-cbbffa1c117d service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:54:54.069673 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1204/2386] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:55:02.832392 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=48 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:04.061582 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=6 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:05.928227 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03679a-766b-48b6-a0ec-4451adae181c service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:55:05.936831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03679a-766b-48b6-a0ec-4451adae181c service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:55:05.940535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb696032-2382-4fc1-8343-6275607c4264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:55:05.941162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb696032-2382-4fc1-8343-6275607c4264 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:55:05.941445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb696032-2382-4fc1-8343-6275607c4264 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:55:05.941724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb696032-2382-4fc1-8343-6275607c4264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:55:05.943636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bb696032-2382-4fc1-8343-6275607c4264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:55:06.004153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb696032-2382-4fc1-8343-6275607c4264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:55:06.005625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb696032-2382-4fc1-8343-6275607c4264 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:55:06.014592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1183/2387] 10.222.0.39 () {60 vars in 1396 bytes} [Thu Jun 23 10:55:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:55:15.037922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eeed4-c199-4a55-9b7f-903bc7308eee None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:55:15.038517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eeed4-c199-4a55-9b7f-903bc7308eee None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:55:15.038754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eeed4-c199-4a55-9b7f-903bc7308eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:55:15.056269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ea9eeed4-c199-4a55-9b7f-903bc7308eee None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:55:15.057470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ea9eeed4-c199-4a55-9b7f-903bc7308eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:55:15.064588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1205/2388] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 23 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:55:15.086472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb696032-2382-4fc1-8343-6275607c4264 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:55:15.098852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb696032-2382-4fc1-8343-6275607c4264 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:55:15.103812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78148f27-e6e7-4772-b665-ee1036d7981e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:55:15.104437 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148f27-e6e7-4772-b665-ee1036d7981e service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:55:15.104717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148f27-e6e7-4772-b665-ee1036d7981e service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:55:15.104995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148f27-e6e7-4772-b665-ee1036d7981e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:55:15.113250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78148f27-e6e7-4772-b665-ee1036d7981e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:55:15.114867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78148f27-e6e7-4772-b665-ee1036d7981e service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:55:15.122765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1184/2389] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:55:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:55:25.051540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:25.119600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=34 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:26.741341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eeed4-c199-4a55-9b7f-903bc7308eee None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:55:26.742778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ea9eeed4-c199-4a55-9b7f-903bc7308eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:55:26.758469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eeed4-c199-4a55-9b7f-903bc7308eee None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:55:26.763769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243589e1-5251-4022-af3c-22a880424c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:55:26.764401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243589e1-5251-4022-af3c-22a880424c86 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:55:26.764689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243589e1-5251-4022-af3c-22a880424c86 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:55:26.764972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243589e1-5251-4022-af3c-22a880424c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:55:26.766706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-243589e1-5251-4022-af3c-22a880424c86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:55:26.824239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243589e1-5251-4022-af3c-22a880424c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:55:26.826198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243589e1-5251-4022-af3c-22a880424c86 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:55:26.835485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1206/2390] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:55:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:55:36.831239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=28 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:55:53.823798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78148f27-e6e7-4772-b665-ee1036d7981e service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:55:53.833723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78148f27-e6e7-4772-b665-ee1036d7981e service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:55:53.837319 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9df88-4cbb-4524-8493-f884a9ad1507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:55:53.837950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9df88-4cbb-4524-8493-f884a9ad1507 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:55:53.838234 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9df88-4cbb-4524-8493-f884a9ad1507 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:55:53.838553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9df88-4cbb-4524-8493-f884a9ad1507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:55:53.840329 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-01e9df88-4cbb-4524-8493-f884a9ad1507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:55:53.850265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9df88-4cbb-4524-8493-f884a9ad1507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:55:53.851705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9df88-4cbb-4524-8493-f884a9ad1507 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:55:53.859644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1185/2391] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:55:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:55:56.025759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3398-8400-486b-8c19-1b1ae0f2eb61 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:55:56.026290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3398-8400-486b-8c19-1b1ae0f2eb61 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:55:56.026430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc3398-8400-486b-8c19-1b1ae0f2eb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:55:56.043859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-c0dc3398-8400-486b-8c19-1b1ae0f2eb61 None None] MFA Rules not processed for user `d230950f9e984a8b878d7d0f74dda3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:55:56.045069 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c0dc3398-8400-486b-8c19-1b1ae0f2eb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:55:56.052222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1207/2392] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:55:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:56:02.082950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9df88-4cbb-4524-8493-f884a9ad1507 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:02.096111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9df88-4cbb-4524-8493-f884a9ad1507 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:02.102390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f24494-e994-4663-b18c-6097560156f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:02.103043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f24494-e994-4663-b18c-6097560156f3 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:02.103325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f24494-e994-4663-b18c-6097560156f3 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:02.103602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f24494-e994-4663-b18c-6097560156f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:02.105338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-37f24494-e994-4663-b18c-6097560156f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:02.118573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f24494-e994-4663-b18c-6097560156f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:02.120175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f24494-e994-4663-b18c-6097560156f3 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:02.131852 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1186/2393] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:04.759791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc3398-8400-486b-8c19-1b1ae0f2eb61 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:04.772695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc3398-8400-486b-8c19-1b1ae0f2eb61 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:04.778098 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767d815-d894-4e09-bca5-afe2cea0852e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:04.778764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767d815-d894-4e09-bca5-afe2cea0852e service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:04.779057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767d815-d894-4e09-bca5-afe2cea0852e service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:04.779338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767d815-d894-4e09-bca5-afe2cea0852e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:04.781100 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a767d815-d894-4e09-bca5-afe2cea0852e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:04.839889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767d815-d894-4e09-bca5-afe2cea0852e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:04.841491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767d815-d894-4e09-bca5-afe2cea0852e service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:04.851251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1208/2394] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 10:56:08.286162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f24494-e994-4663-b18c-6097560156f3 service nova] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:08.297705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f24494-e994-4663-b18c-6097560156f3 service nova] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:08.303902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a0147-5943-4083-9e6a-e063fc7f105e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:08.304562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a0147-5943-4083-9e6a-e063fc7f105e service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:08.304846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a0147-5943-4083-9e6a-e063fc7f105e service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:08.305124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a0147-5943-4083-9e6a-e063fc7f105e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:08.306972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9e4a0147-5943-4083-9e6a-e063fc7f105e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:08.320700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a0147-5943-4083-9e6a-e063fc7f105e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:08.323098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a0147-5943-4083-9e6a-e063fc7f105e service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:08.335102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1187/2395] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:14.846458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=31 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:18.328978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=18 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:18.575664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22433b1-43b6-4518-a0d3-ef4a14781195 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:18.576164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22433b1-43b6-4518-a0d3-ef4a14781195 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:18.576275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22433b1-43b6-4518-a0d3-ef4a14781195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:18.593052 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d22433b1-43b6-4518-a0d3-ef4a14781195 None None] MFA Rules not processed for user `eb8df5670686403480cdfd32ac408945`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:18.594273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d22433b1-43b6-4518-a0d3-ef4a14781195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:18.602187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1209/2396] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:56:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:18.915381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a0147-5943-4083-9e6a-e063fc7f105e service nova] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:18.925267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a0147-5943-4083-9e6a-e063fc7f105e service nova] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:18.929025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b706b-d093-49ae-a788-ce4186864cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:18.929688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b706b-d093-49ae-a788-ce4186864cae service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:18.929974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b706b-d093-49ae-a788-ce4186864cae service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:18.930255 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b706b-d093-49ae-a788-ce4186864cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:18.932087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0c7b706b-d093-49ae-a788-ce4186864cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:18.942180 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b706b-d093-49ae-a788-ce4186864cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:18.943623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b706b-d093-49ae-a788-ce4186864cae service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:18.951775 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1188/2397] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:20.274749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22433b1-43b6-4518-a0d3-ef4a14781195 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:20.276130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d22433b1-43b6-4518-a0d3-ef4a14781195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:20.345174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22433b1-43b6-4518-a0d3-ef4a14781195 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:20.350784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d38093-b0ff-47b5-b259-1682133f25f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:20.351432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d38093-b0ff-47b5-b259-1682133f25f6 service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:20.351714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d38093-b0ff-47b5-b259-1682133f25f6 service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:20.351992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d38093-b0ff-47b5-b259-1682133f25f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:20.353752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-06d38093-b0ff-47b5-b259-1682133f25f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:20.366189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d38093-b0ff-47b5-b259-1682133f25f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:20.367831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d38093-b0ff-47b5-b259-1682133f25f6 service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:20.378051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1210/2398] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:28.948016 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:30.373491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=35 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:32.872328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e144b-0f66-4e6c-9ac1-1f5bf206218e None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:32.872774 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e144b-0f66-4e6c-9ac1-1f5bf206218e None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:32.872918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e144b-0f66-4e6c-9ac1-1f5bf206218e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:32.892101 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-135e144b-0f66-4e6c-9ac1-1f5bf206218e None None] MFA Rules not processed for user `b0b95c321c4a452faa81a93168c7bf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:32.893422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-135e144b-0f66-4e6c-9ac1-1f5bf206218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:32.900713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1189/2399] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:56:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:35.146235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d38093-b0ff-47b5-b259-1682133f25f6 service placement] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:35.164416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d38093-b0ff-47b5-b259-1682133f25f6 service placement] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:35.170689 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d0fe4-aabe-4f72-a93a-02ae6caab0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:35.171692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d0fe4-aabe-4f72-a93a-02ae6caab0a7 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:35.172173 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d0fe4-aabe-4f72-a93a-02ae6caab0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:35.172635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d0fe4-aabe-4f72-a93a-02ae6caab0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:35.175764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ef5d0fe4-aabe-4f72-a93a-02ae6caab0a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:35.193056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d0fe4-aabe-4f72-a93a-02ae6caab0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:35.195248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d0fe4-aabe-4f72-a93a-02ae6caab0a7 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:35.208712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1211/2400] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:42.886675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:45.202719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=6 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:49.862436 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d1cab-056e-49a3-a8f8-e71fbae843ad None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:49.863582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d1cab-056e-49a3-a8f8-e71fbae843ad None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:49.863863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d1cab-056e-49a3-a8f8-e71fbae843ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:49.881666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-121d1cab-056e-49a3-a8f8-e71fbae843ad None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:49.882890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-121d1cab-056e-49a3-a8f8-e71fbae843ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:49.890262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1190/2401] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 23 10:56:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:56:49.939141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d0fe4-aabe-4f72-a93a-02ae6caab0a7 service nova] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:49.950662 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d0fe4-aabe-4f72-a93a-02ae6caab0a7 service nova] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:49.955757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e982-7c28-44e0-86af-49deec456ea7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:49.956918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e982-7c28-44e0-86af-49deec456ea7 service swift] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:49.957292 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e982-7c28-44e0-86af-49deec456ea7 service swift] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:49.957537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e982-7c28-44e0-86af-49deec456ea7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:49.965660 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62e982-7c28-44e0-86af-49deec456ea7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:49.967285 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62e982-7c28-44e0-86af-49deec456ea7 service swift] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:49.975724 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1212/2402] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:56:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:56:50.376197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228f918-9c6b-4436-8390-0f19012d1d2a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:50.376491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228f918-9c6b-4436-8390-0f19012d1d2a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:50.376769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228f918-9c6b-4436-8390-0f19012d1d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:50.395372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-6228f918-9c6b-4436-8390-0f19012d1d2a None None] MFA Rules not processed for user `10ae039c34c442f880c51aaf9024db8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:56:50.396860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6228f918-9c6b-4436-8390-0f19012d1d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:50.474710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1191/2403] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:56:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 10:56:51.051189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e982-7c28-44e0-86af-49deec456ea7 service swift] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:51.068237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e982-7c28-44e0-86af-49deec456ea7 service swift] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:51.072428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e88562-cb2e-42d6-a281-9587e68ac695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:51.073579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e88562-cb2e-42d6-a281-9587e68ac695 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:51.074170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e88562-cb2e-42d6-a281-9587e68ac695 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:51.074878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e88562-cb2e-42d6-a281-9587e68ac695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:51.077373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f4e88562-cb2e-42d6-a281-9587e68ac695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:51.092697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e88562-cb2e-42d6-a281-9587e68ac695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:51.094732 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e88562-cb2e-42d6-a281-9587e68ac695 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:51.104578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1213/2404] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:56:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:56:58.514855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228f918-9c6b-4436-8390-0f19012d1d2a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:58.516333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6228f918-9c6b-4436-8390-0f19012d1d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:58.587604 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228f918-9c6b-4436-8390-0f19012d1d2a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:58.592588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:58.593451 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:58.593860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:58.594159 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] PATH_INFO: `/v3/users/6dbb7fcbd9604a87a8b4dd380ca9cd56` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:58.595663 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dbb7fcbd9604a87a8b4dd380ca9cd56)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:58.599164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:58.653814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dbb7fcbd9604a87a8b4dd380ca9cd56'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:58.653814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dbb7fcbd9604a87a8b4dd380ca9cd56'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:58.668598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dbb7fcbd9604a87a8b4dd380ca9cd56'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:58.676135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dbb7fcbd9604a87a8b4dd380ca9cd56'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:58.689860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dbb7fcbd9604a87a8b4dd380ca9cd56'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:58.697191 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1192/2405] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:56:58 2022] DELETE /identity/v3/users/6dbb7fcbd9604a87a8b4dd380ca9cd56 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:56:58.917565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e88562-cb2e-42d6-a281-9587e68ac695 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:58.931640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e88562-cb2e-42d6-a281-9587e68ac695 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:58.989920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:58.990806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:58.991087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:58.991363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] PATH_INFO: `/v3/projects/9024c2d0554a4270bbc9222800e9dcb6` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:58.992550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9024c2d0554a4270bbc9222800e9dcb6)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:58.994525 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:59.041975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9024c2d0554a4270bbc9222800e9dcb6', 'request_id': 'req-98992d34-51e3-4947-80ac-f93a06428506'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.048914 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9024c2d0554a4270bbc9222800e9dcb6', 'request_id': 'req-98992d34-51e3-4947-80ac-f93a06428506'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.060199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9024c2d0554a4270bbc9222800e9dcb6', 'request_id': 'req-98992d34-51e3-4947-80ac-f93a06428506'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.072131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] The token cache is being invalidate because project 9024c2d0554a4270bbc9222800e9dcb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:56:59.072425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.073085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.074678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1214/2406] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:56:58 2022] DELETE /identity/v3/projects/9024c2d0554a4270bbc9222800e9dcb6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:56:59.078835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:59.080257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:59.094056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fbb08-b01a-408b-bfef-780f90fbaca1 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:59.107051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:59.152861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:59.153713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:59.153995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:59.154270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] PATH_INFO: `/v3/users/bdb094c631b44105b27b6a6e43a1330d` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:59.155478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb094c631b44105b27b6a6e43a1330d)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:59.157380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:59.202773 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb094c631b44105b27b6a6e43a1330d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.203334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb094c631b44105b27b6a6e43a1330d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.216095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb094c631b44105b27b6a6e43a1330d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.223259 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb094c631b44105b27b6a6e43a1330d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.230822 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb094c631b44105b27b6a6e43a1330d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.237086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1193/2407] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:56:59 2022] DELETE /identity/v3/users/bdb094c631b44105b27b6a6e43a1330d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:56:59.415548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:56:59.419360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:56:59.433090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98992d34-51e3-4947-80ac-f93a06428506 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:56:59.515416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:56:59.516322 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:56:59.516605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:56:59.516881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] PATH_INFO: `/v3/projects/886f8937cb8446779ec40916ca49a47f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:56:59.521238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=886f8937cb8446779ec40916ca49a47f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:56:59.523284 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:56:59.530242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:56:59.583259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886f8937cb8446779ec40916ca49a47f', 'request_id': 'req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.590905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886f8937cb8446779ec40916ca49a47f', 'request_id': 'req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.599716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886f8937cb8446779ec40916ca49a47f', 'request_id': 'req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.611033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] The token cache is being invalidate because project 886f8937cb8446779ec40916ca49a47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:56:59.611349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.611997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:56:59.614477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1215/2408] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:56:59 2022] DELETE /identity/v3/projects/886f8937cb8446779ec40916ca49a47f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:57:09.233279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:09.607992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:18.233086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:18.234546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:18.290762 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216a4ed-983d-4be3-a02a-fecd79989422 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:18.338052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:18.338716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:18.339000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:18.339280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:18.341030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:18.401571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:18.403026 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:18.413359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1194/2409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:57:21.600356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:21.602831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:21.694201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:21.695639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:21.703049 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38648c-a49a-4cd5-a04d-c64afd6bfa70 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:21.707787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a90d5d-d1d6-441d-9a94-7ccb3d61e12c service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:21.709304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3949aa2-2b96-401f-8ab4-74fcf147b500 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:21.710191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3949aa2-2b96-401f-8ab4-74fcf147b500 service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:21.710555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3949aa2-2b96-401f-8ab4-74fcf147b500 service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:21.710967 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3949aa2-2b96-401f-8ab4-74fcf147b500 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:21.712432 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:21.712842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f3949aa2-2b96-401f-8ab4-74fcf147b500 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:21.713292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:21.713572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:21.713850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] PATH_INFO: `/v3/users/d230950f9e984a8b878d7d0f74dda3ce` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:21.715219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d230950f9e984a8b878d7d0f74dda3ce)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:21.717229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:21.726559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3949aa2-2b96-401f-8ab4-74fcf147b500 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:21.728217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3949aa2-2b96-401f-8ab4-74fcf147b500 service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:21.739363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1216/2410] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:57:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:57:21.772847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd230950f9e984a8b878d7d0f74dda3ce'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:21.773502 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd230950f9e984a8b878d7d0f74dda3ce'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:21.783384 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:21.786357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd230950f9e984a8b878d7d0f74dda3ce'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:21.794670 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd230950f9e984a8b878d7d0f74dda3ce'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:21.802209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-3d90c013-a059-4685-8491-d7c6ff9d354d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd230950f9e984a8b878d7d0f74dda3ce'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:21.808526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1195/2411] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 10:57:21 2022] DELETE /identity/v3/users/d230950f9e984a8b878d7d0f74dda3ce => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:57:21.983237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3949aa2-2b96-401f-8ab4-74fcf147b500 service placement] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:21.997543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3949aa2-2b96-401f-8ab4-74fcf147b500 service placement] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:22.056944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:22.057798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.058084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.058391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] PATH_INFO: `/v3/projects/eacce04e67d14a2f8ae63f5cd115b69c` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.059572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eacce04e67d14a2f8ae63f5cd115b69c)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:22.061520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:22.109679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eacce04e67d14a2f8ae63f5cd115b69c', 'request_id': 'req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:22.116952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eacce04e67d14a2f8ae63f5cd115b69c', 'request_id': 'req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:22.123465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eacce04e67d14a2f8ae63f5cd115b69c', 'request_id': 'req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:22.133996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] The token cache is being invalidate because project eacce04e67d14a2f8ae63f5cd115b69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 10:57:22.134287 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:22.134947 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-390d34a5-0ac6-46a1-93cf-428b79f0b3bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 10:57:22.136474 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1217/2412] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 10:57:21 2022] DELETE /identity/v3/projects/eacce04e67d14a2f8ae63f5cd115b69c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:57:22.141377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a374b-0182-4f1a-8751-e2214d24ccfb None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.141672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a374b-0182-4f1a-8751-e2214d24ccfb None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.141958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a374b-0182-4f1a-8751-e2214d24ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.159954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3c2a374b-0182-4f1a-8751-e2214d24ccfb None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:57:22.162173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3c2a374b-0182-4f1a-8751-e2214d24ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:22.223725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1196/2413] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:57:22.231736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba200-16f2-431f-90b3-777dbf83ee59 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.232028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba200-16f2-431f-90b3-777dbf83ee59 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.232311 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba200-16f2-431f-90b3-777dbf83ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.250432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-11fba200-16f2-431f-90b3-777dbf83ee59 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:57:22.251648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-11fba200-16f2-431f-90b3-777dbf83ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:22.259847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1218/2414] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:57:22.263969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a374b-0182-4f1a-8751-e2214d24ccfb None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:22.274405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a374b-0182-4f1a-8751-e2214d24ccfb None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:22.278887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1292f-7340-4f4a-84bd-4d648ec84a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:22.279558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1292f-7340-4f4a-84bd-4d648ec84a57 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.279837 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1292f-7340-4f4a-84bd-4d648ec84a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.280112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1292f-7340-4f4a-84bd-4d648ec84a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.280828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1292f-7340-4f4a-84bd-4d648ec84a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:57:22.281132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1292f-7340-4f4a-84bd-4d648ec84a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:22.282754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1292f-7340-4f4a-84bd-4d648ec84a57 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:22.294889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1197/2415] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 10:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:57:22.299120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba200-16f2-431f-90b3-777dbf83ee59 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:22.308805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba200-16f2-431f-90b3-777dbf83ee59 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:22.313548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafca16-6542-4bcd-85f5-27096894a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:22.314231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafca16-6542-4bcd-85f5-27096894a176 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.314550 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafca16-6542-4bcd-85f5-27096894a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.314833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafca16-6542-4bcd-85f5-27096894a176 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.315539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafca16-6542-4bcd-85f5-27096894a176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:22.318095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafca16-6542-4bcd-85f5-27096894a176 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:22.330208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:22.358387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1219/2416] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 10:57:22 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:57:22.362518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1292f-7340-4f4a-84bd-4d648ec84a57 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:22.372797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1292f-7340-4f4a-84bd-4d648ec84a57 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:22.430284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17302c56-1f99-4791-88c3-5f727021b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:22.430985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17302c56-1f99-4791-88c3-5f727021b1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.431270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17302c56-1f99-4791-88c3-5f727021b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.431555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17302c56-1f99-4791-88c3-5f727021b1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.432255 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17302c56-1f99-4791-88c3-5f727021b1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:22.434187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17302c56-1f99-4791-88c3-5f727021b1c7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:22.453737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1198/2417] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 10:57:22 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:57:22.458329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafca16-6542-4bcd-85f5-27096894a176 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:22.468484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafca16-6542-4bcd-85f5-27096894a176 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:22.474090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c361ccf-a723-4579-8e86-ee752e23324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:22.474792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c361ccf-a723-4579-8e86-ee752e23324e admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.475081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c361ccf-a723-4579-8e86-ee752e23324e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.475362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c361ccf-a723-4579-8e86-ee752e23324e admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.476369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c361ccf-a723-4579-8e86-ee752e23324e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:22.477969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c361ccf-a723-4579-8e86-ee752e23324e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:22.487781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1220/2418] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:57:22.492218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17302c56-1f99-4791-88c3-5f727021b1c7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:22.501900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17302c56-1f99-4791-88c3-5f727021b1c7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:22.506726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537d6af-7074-45c3-91c5-a90b28f6ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:22.507367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537d6af-7074-45c3-91c5-a90b28f6ddaf admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.507650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537d6af-7074-45c3-91c5-a90b28f6ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.507925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537d6af-7074-45c3-91c5-a90b28f6ddaf admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.508636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537d6af-7074-45c3-91c5-a90b28f6ddaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:22.510231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3537d6af-7074-45c3-91c5-a90b28f6ddaf admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:22.520201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1199/2419] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 10:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:57:22.524224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c361ccf-a723-4579-8e86-ee752e23324e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:22.534633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c361ccf-a723-4579-8e86-ee752e23324e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:22.539945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78069ef-7b8b-4c81-8367-ca9b146f6045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:22.540844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78069ef-7b8b-4c81-8367-ca9b146f6045 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.541122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78069ef-7b8b-4c81-8367-ca9b146f6045 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.541753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78069ef-7b8b-4c81-8367-ca9b146f6045 admin admin] PATH_INFO: `/v3/projects/737af05e60014fe88e0238e00afb39c6/users/845a039c954f4384917100206698d015/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.556953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78069ef-7b8b-4c81-8367-ca9b146f6045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=737af05e60014fe88e0238e00afb39c6, user_id=845a039c954f4384917100206698d015, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:22.559644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78069ef-7b8b-4c81-8367-ca9b146f6045 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:22.571840 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1221/2420] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 10:57:22 2022] PUT /identity/v3/projects/737af05e60014fe88e0238e00afb39c6/users/845a039c954f4384917100206698d015/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:57:22.577177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa69c-0e83-4b1c-b57c-fd061e632431 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.577463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa69c-0e83-4b1c-b57c-fd061e632431 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.577744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa69c-0e83-4b1c-b57c-fd061e632431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.595556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-472aa69c-0e83-4b1c-b57c-fd061e632431 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:57:22.596746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-472aa69c-0e83-4b1c-b57c-fd061e632431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:22.638564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:22.659233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1200/2421] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:57:22.669569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78069ef-7b8b-4c81-8367-ca9b146f6045 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:22.673485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c78069ef-7b8b-4c81-8367-ca9b146f6045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:22.737610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78069ef-7b8b-4c81-8367-ca9b146f6045 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:22.741530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf496b-ad36-4a39-9f37-0c7dad1c86b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:22.742174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf496b-ad36-4a39-9f37-0c7dad1c86b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:22.742501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf496b-ad36-4a39-9f37-0c7dad1c86b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:22.742781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf496b-ad36-4a39-9f37-0c7dad1c86b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:22.751742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf496b-ad36-4a39-9f37-0c7dad1c86b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:22.753175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf496b-ad36-4a39-9f37-0c7dad1c86b7 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:22.762748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1222/2422] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:57:26.678938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d9847-ff5b-47be-b735-e879800f8064 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:26.679455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d9847-ff5b-47be-b735-e879800f8064 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:26.679554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d9847-ff5b-47be-b735-e879800f8064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:26.708230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-1a3d9847-ff5b-47be-b735-e879800f8064 None None] MFA Rules not processed for user `845a039c954f4384917100206698d015`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:57:26.709369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1a3d9847-ff5b-47be-b735-e879800f8064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:26.777618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1201/2423] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:57:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:57:26.792364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf496b-ad36-4a39-9f37-0c7dad1c86b7 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:57:26.794440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c3bf496b-ad36-4a39-9f37-0c7dad1c86b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:26.875147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf496b-ad36-4a39-9f37-0c7dad1c86b7 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:57:26.881610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16e44e-a9b3-4d22-bcdb-f089662c049e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:57:26.882178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16e44e-a9b3-4d22-bcdb-f089662c049e service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:26.882522 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16e44e-a9b3-4d22-bcdb-f089662c049e service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:26.882996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16e44e-a9b3-4d22-bcdb-f089662c049e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:26.891382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16e44e-a9b3-4d22-bcdb-f089662c049e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:57:26.892960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d16e44e-a9b3-4d22-bcdb-f089662c049e service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:57:26.902266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1223/2424] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:57:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:57:28.259693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23c79-0369-4027-ac73-a0a0328f405f None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:57:28.260203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23c79-0369-4027-ac73-a0a0328f405f None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:57:28.260308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23c79-0369-4027-ac73-a0a0328f405f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:57:28.277417 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-91a23c79-0369-4027-ac73-a0a0328f405f None None] MFA Rules not processed for user `845a039c954f4384917100206698d015`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:57:28.278636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-91a23c79-0369-4027-ac73-a0a0328f405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:57:28.285499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1202/2425] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:57:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:57:36.898036 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=82,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:57:38.272179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=42 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:09.574291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16e44e-a9b3-4d22-bcdb-f089662c049e service nova] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:09.577347 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6d16e44e-a9b3-4d22-bcdb-f089662c049e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:09.654566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16e44e-a9b3-4d22-bcdb-f089662c049e service nova] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:09.661318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088d1ae-cd1d-4926-a9a7-bda70281298c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:09.662167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088d1ae-cd1d-4926-a9a7-bda70281298c service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:09.662648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088d1ae-cd1d-4926-a9a7-bda70281298c service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:09.663208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088d1ae-cd1d-4926-a9a7-bda70281298c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:09.665258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c088d1ae-cd1d-4926-a9a7-bda70281298c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:09.678817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088d1ae-cd1d-4926-a9a7-bda70281298c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:09.680486 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088d1ae-cd1d-4926-a9a7-bda70281298c service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:09.692410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1224/2426] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:58:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:58:12.884544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6a57d-b63b-44bf-a57a-19331ac9b867 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:12.885052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6a57d-b63b-44bf-a57a-19331ac9b867 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:12.885156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6a57d-b63b-44bf-a57a-19331ac9b867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:12.902431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-0ed6a57d-b63b-44bf-a57a-19331ac9b867 None None] MFA Rules not processed for user `eb8df5670686403480cdfd32ac408945`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:12.903665 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0ed6a57d-b63b-44bf-a57a-19331ac9b867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:12.958538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1203/2427] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:58:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:19.687803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=32 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:22.951151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=25 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:33.093490 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be080ef-eeb9-42ea-9a3e-1e05025aee43 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:33.094010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be080ef-eeb9-42ea-9a3e-1e05025aee43 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:33.094116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be080ef-eeb9-42ea-9a3e-1e05025aee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:33.111402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-4be080ef-eeb9-42ea-9a3e-1e05025aee43 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:33.112587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4be080ef-eeb9-42ea-9a3e-1e05025aee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:33.173768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1225/2428] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:58:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:33.221710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6a57d-b63b-44bf-a57a-19331ac9b867 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:33.223187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0ed6a57d-b63b-44bf-a57a-19331ac9b867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:33.296194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6a57d-b63b-44bf-a57a-19331ac9b867 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:33.301206 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541c7c0-e115-44aa-8e8b-1337a440b745 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:33.301850 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541c7c0-e115-44aa-8e8b-1337a440b745 service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:33.302135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541c7c0-e115-44aa-8e8b-1337a440b745 service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:33.302450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541c7c0-e115-44aa-8e8b-1337a440b745 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:33.311146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541c7c0-e115-44aa-8e8b-1337a440b745 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:33.312732 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541c7c0-e115-44aa-8e8b-1337a440b745 service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:33.321621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1204/2429] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:58:43.167180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=25 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:43.317649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=32 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:48.969214 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac464131-1555-488b-a853-e8c52ff7d2c6 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:48.969694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac464131-1555-488b-a853-e8c52ff7d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:48.969790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac464131-1555-488b-a853-e8c52ff7d2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:48.987189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ac464131-1555-488b-a853-e8c52ff7d2c6 None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:58:48.988397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ac464131-1555-488b-a853-e8c52ff7d2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:58:48.995960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1226/2430] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jun 23 10:58:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:58:49.008279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541c7c0-e115-44aa-8e8b-1337a440b745 service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:58:49.018714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541c7c0-e115-44aa-8e8b-1337a440b745 service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:58:49.023761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f8e7-3b11-46ab-b7b0-54a19abd9635 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:58:49.024389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f8e7-3b11-46ab-b7b0-54a19abd9635 service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:58:49.024675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f8e7-3b11-46ab-b7b0-54a19abd9635 service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:58:49.024955 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f8e7-3b11-46ab-b7b0-54a19abd9635 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:58:49.032992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216f8e7-3b11-46ab-b7b0-54a19abd9635 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:58:49.034601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216f8e7-3b11-46ab-b7b0-54a19abd9635 service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:58:49.042952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1205/2431] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:58:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:58:58.982048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:58:59.039705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:09.901560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b88608-f0a4-48b9-b7ab-d283e220a7ca None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.902016 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b88608-f0a4-48b9-b7ab-d283e220a7ca None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.902114 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b88608-f0a4-48b9-b7ab-d283e220a7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.921590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-44b88608-f0a4-48b9-b7ab-d283e220a7ca None None] MFA Rules not processed for user `8dcf5fbe26e44d858d5a2f708cd28c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:09.922813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-44b88608-f0a4-48b9-b7ab-d283e220a7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:09.929862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1227/2432] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jun 23 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:09.942733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f8e7-3b11-46ab-b7b0-54a19abd9635 service swift] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:09.953766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f8e7-3b11-46ab-b7b0-54a19abd9635 service swift] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:09.958858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cae397-4754-4fdc-88d7-2e937aaf3a50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf19adc48f0439b9cdcb1aaedd58a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:09.959492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cae397-4754-4fdc-88d7-2e937aaf3a50 service swift] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:09.959778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cae397-4754-4fdc-88d7-2e937aaf3a50 service swift] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:09.960060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cae397-4754-4fdc-88d7-2e937aaf3a50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:09.968495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cae397-4754-4fdc-88d7-2e937aaf3a50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:09.970076 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cae397-4754-4fdc-88d7-2e937aaf3a50 service swift] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:09.978379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1206/2433] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jun 23 10:59:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:59:12.580622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b88608-f0a4-48b9-b7ab-d283e220a7ca None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:12.582003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-44b88608-f0a4-48b9-b7ab-d283e220a7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.636161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b88608-f0a4-48b9-b7ab-d283e220a7ca None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:12.640221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6e53c-5a5c-4f3c-bd7c-ce3698198574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:12.640853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e53c-5a5c-4f3c-bd7c-ce3698198574 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:12.641136 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e53c-5a5c-4f3c-bd7c-ce3698198574 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:12.641414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e53c-5a5c-4f3c-bd7c-ce3698198574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:12.643171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-63e6e53c-5a5c-4f3c-bd7c-ce3698198574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:12.701296 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6e53c-5a5c-4f3c-bd7c-ce3698198574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:12.703001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6e53c-5a5c-4f3c-bd7c-ce3698198574 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:12.711770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1228/2434] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:19.975201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:22.707796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=51 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:23.697574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5386e-9400-424c-8b1a-e4d084d1cafa None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:23.698086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5386e-9400-424c-8b1a-e4d084d1cafa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:23.698186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5386e-9400-424c-8b1a-e4d084d1cafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:23.716508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-37d5386e-9400-424c-8b1a-e4d084d1cafa None None] MFA Rules not processed for user `10ae039c34c442f880c51aaf9024db8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:59:23.717745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-37d5386e-9400-424c-8b1a-e4d084d1cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:23.724714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1207/2435] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 10:59:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 10:59:33.710722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:59:41.530950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6e53c-5a5c-4f3c-bd7c-ce3698198574 service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:59:41.540317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6e53c-5a5c-4f3c-bd7c-ce3698198574 service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:59:41.544723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95ba9b-fe75-4a7d-a092-d49e17de29ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:59:41.545353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ba9b-fe75-4a7d-a092-d49e17de29ef service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:59:41.545634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ba9b-fe75-4a7d-a092-d49e17de29ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:59:41.545908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95ba9b-fe75-4a7d-a092-d49e17de29ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:59:41.547684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3b95ba9b-fe75-4a7d-a092-d49e17de29ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:59:41.610158 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95ba9b-fe75-4a7d-a092-d49e17de29ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:59:41.611624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95ba9b-fe75-4a7d-a092-d49e17de29ef service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:59:41.621060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1229/2436] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 10:59:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 10:59:51.620276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=30 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:04.976105 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5386e-9400-424c-8b1a-e4d084d1cafa None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:04.977577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-37d5386e-9400-424c-8b1a-e4d084d1cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:04.992044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5386e-9400-424c-8b1a-e4d084d1cafa None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:04.995778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:04.996961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:04.997218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:04.997529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:04.999313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:05.014910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:05.016372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:05.028479 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1208/2437] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:12.918905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95ba9b-fe75-4a7d-a092-d49e17de29ef service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:12.928353 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95ba9b-fe75-4a7d-a092-d49e17de29ef service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:12.931915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc981-5893-41cd-8618-1cd2af88c645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:12.932546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc981-5893-41cd-8618-1cd2af88c645 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:12.932834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc981-5893-41cd-8618-1cd2af88c645 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:12.933118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dc981-5893-41cd-8618-1cd2af88c645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:12.934974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0c6dc981-5893-41cd-8618-1cd2af88c645 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:12.948444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dc981-5893-41cd-8618-1cd2af88c645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:12.950391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6dc981-5893-41cd-8618-1cd2af88c645 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:12.961950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1230/2438] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:15.023032 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:22.956779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=6 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:23.258021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:23.259464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:23.271210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b32304-7574-4257-b4e1-f9e669dfaca2 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:23.274804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:23.275441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:23.275729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:23.276009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:23.278214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:23.290070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:23.291542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:23.301965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1209/2439] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:26.442821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc981-5893-41cd-8618-1cd2af88c645 service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:26.461849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dc981-5893-41cd-8618-1cd2af88c645 service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:26.468263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26379f9-e506-44cf-b0fc-9fc521ffdc98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:26.469259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26379f9-e506-44cf-b0fc-9fc521ffdc98 service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:26.469650 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26379f9-e506-44cf-b0fc-9fc521ffdc98 service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:26.470045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26379f9-e506-44cf-b0fc-9fc521ffdc98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:26.472084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b26379f9-e506-44cf-b0fc-9fc521ffdc98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:26.486625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26379f9-e506-44cf-b0fc-9fc521ffdc98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:26.488629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26379f9-e506-44cf-b0fc-9fc521ffdc98 service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:26.505801 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1231/2440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:26.511076 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:26.513637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:26.540802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568d84b-0309-45be-8afc-82c51e16fd5b service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:26.548648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:26.549649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:26.551172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:26.551172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] PATH_INFO: `/v3/users/eb8df5670686403480cdfd32ac408945` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:26.569598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8df5670686403480cdfd32ac408945)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:26.571772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:26.628220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8df5670686403480cdfd32ac408945'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.628915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8df5670686403480cdfd32ac408945'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.642019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8df5670686403480cdfd32ac408945'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.648878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8df5670686403480cdfd32ac408945'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.657271 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6054c145-259e-456f-b8b8-ee3c652b2b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8df5670686403480cdfd32ac408945'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:26.663557 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1210/2441] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:26 2022] DELETE /identity/v3/users/eb8df5670686403480cdfd32ac408945 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:26.848400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26379f9-e506-44cf-b0fc-9fc521ffdc98 service placement] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:26.862118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26379f9-e506-44cf-b0fc-9fc521ffdc98 service placement] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:26.929447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:26.930253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:26.930567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:26.930842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] PATH_INFO: `/v3/projects/2123ff10502044b9aea48720440c2291` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:26.944074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2123ff10502044b9aea48720440c2291)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:26.946006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:26.995616 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2123ff10502044b9aea48720440c2291', 'request_id': 'req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.005120 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2123ff10502044b9aea48720440c2291', 'request_id': 'req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.013472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2123ff10502044b9aea48720440c2291', 'request_id': 'req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.024098 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] The token cache is being invalidate because project 2123ff10502044b9aea48720440c2291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:27.024387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.025051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-c69d6f7f-3611-4e83-9b6d-3686f3ba5a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:27.026643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1232/2442] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:26 2022] DELETE /identity/v3/projects/2123ff10502044b9aea48720440c2291 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:27.032009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214483-0866-49b6-92a5-2cb293b70ab9 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.032340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214483-0866-49b6-92a5-2cb293b70ab9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.032670 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b214483-0866-49b6-92a5-2cb293b70ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.056285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-1b214483-0866-49b6-92a5-2cb293b70ab9 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:27.057649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1b214483-0866-49b6-92a5-2cb293b70ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:27.126480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1211/2443] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:27.134440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2156-c721-4967-9469-cfbaa576bdcf None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.134733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2156-c721-4967-9469-cfbaa576bdcf None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.135015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c2156-c721-4967-9469-cfbaa576bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.155308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-726c2156-c721-4967-9469-cfbaa576bdcf None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:27.156541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-726c2156-c721-4967-9469-cfbaa576bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:27.164578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1233/2444] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:27.169637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b214483-0866-49b6-92a5-2cb293b70ab9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.179724 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b214483-0866-49b6-92a5-2cb293b70ab9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:27.185087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b708ca-a9b0-42e8-9c0b-c8f08b3099ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:27.185735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b708ca-a9b0-42e8-9c0b-c8f08b3099ca admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.186015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b708ca-a9b0-42e8-9c0b-c8f08b3099ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.186289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b708ca-a9b0-42e8-9c0b-c8f08b3099ca admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.187046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b708ca-a9b0-42e8-9c0b-c8f08b3099ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:00:27.187352 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b708ca-a9b0-42e8-9c0b-c8f08b3099ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:27.188963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b708ca-a9b0-42e8-9c0b-c8f08b3099ca admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:27.201855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1212/2445] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:00:27.206542 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2156-c721-4967-9469-cfbaa576bdcf None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.219931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c2156-c721-4967-9469-cfbaa576bdcf None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:27.227094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b7088-854c-45bc-bd37-b4241befcb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:27.227759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7088-854c-45bc-bd37-b4241befcb9f admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.228046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7088-854c-45bc-bd37-b4241befcb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.228326 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7088-854c-45bc-bd37-b4241befcb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.229030 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b7088-854c-45bc-bd37-b4241befcb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:27.232122 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b7088-854c-45bc-bd37-b4241befcb9f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:27.258701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1234/2446] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:27 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:27.263214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b708ca-a9b0-42e8-9c0b-c8f08b3099ca admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.273544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b708ca-a9b0-42e8-9c0b-c8f08b3099ca admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:27.307701 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:27.335979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ec080-3abf-485d-abd7-0ab7e9f8fb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:27.336680 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ec080-3abf-485d-abd7-0ab7e9f8fb63 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.336968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ec080-3abf-485d-abd7-0ab7e9f8fb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.337246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ec080-3abf-485d-abd7-0ab7e9f8fb63 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.337988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ec080-3abf-485d-abd7-0ab7e9f8fb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:27.340001 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ec080-3abf-485d-abd7-0ab7e9f8fb63 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:27.360743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1213/2447] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:27 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:27.364897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b7088-854c-45bc-bd37-b4241befcb9f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.376687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b7088-854c-45bc-bd37-b4241befcb9f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:27.381408 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0401-f26c-4d97-848f-3f558e857e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:27.382067 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0401-f26c-4d97-848f-3f558e857e8f admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.382378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0401-f26c-4d97-848f-3f558e857e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.382664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0401-f26c-4d97-848f-3f558e857e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.383426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0401-f26c-4d97-848f-3f558e857e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:27.385667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0401-f26c-4d97-848f-3f558e857e8f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:27.396912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1235/2448] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:27.400911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ec080-3abf-485d-abd7-0ab7e9f8fb63 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.411135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ec080-3abf-485d-abd7-0ab7e9f8fb63 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:27.416002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2431ee2-f0ce-40f2-8231-29c235a03f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:27.416712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2431ee2-f0ce-40f2-8231-29c235a03f26 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.417192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2431ee2-f0ce-40f2-8231-29c235a03f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.417471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2431ee2-f0ce-40f2-8231-29c235a03f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.418810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2431ee2-f0ce-40f2-8231-29c235a03f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:27.420706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2431ee2-f0ce-40f2-8231-29c235a03f26 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:27.431175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1214/2449] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:27.436073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0401-f26c-4d97-848f-3f558e857e8f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.447297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0401-f26c-4d97-848f-3f558e857e8f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:27.452511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2caa23-7bc5-412f-9f21-9703dce38d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:27.453695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2caa23-7bc5-412f-9f21-9703dce38d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.453981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2caa23-7bc5-412f-9f21-9703dce38d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.454265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2caa23-7bc5-412f-9f21-9703dce38d0f admin admin] PATH_INFO: `/v3/projects/5c99201bdc7f49a0bd87bc7fa1002f1b/users/2fef5799a5e443b382cfdebb9ec43c9c/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.470413 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2caa23-7bc5-412f-9f21-9703dce38d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c99201bdc7f49a0bd87bc7fa1002f1b, user_id=2fef5799a5e443b382cfdebb9ec43c9c, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:27.473089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2caa23-7bc5-412f-9f21-9703dce38d0f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:27.486859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1236/2450] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:27 2022] PUT /identity/v3/projects/5c99201bdc7f49a0bd87bc7fa1002f1b/users/2fef5799a5e443b382cfdebb9ec43c9c/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:27.497438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b71f4-4925-47ce-a280-a2304b555de8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.497723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b71f4-4925-47ce-a280-a2304b555de8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.497992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b71f4-4925-47ce-a280-a2304b555de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.525889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b92b71f4-4925-47ce-a280-a2304b555de8 None None] MFA Rules not processed for user `2fef5799a5e443b382cfdebb9ec43c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:27.527660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b92b71f4-4925-47ce-a280-a2304b555de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:27.593605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1215/2451] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:27.606437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2caa23-7bc5-412f-9f21-9703dce38d0f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.608317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9b2caa23-7bc5-412f-9f21-9703dce38d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:27.616052 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:27.698402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2caa23-7bc5-412f-9f21-9703dce38d0f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:27.704605 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105eb6-d3d5-45d8-9859-726f3a0899f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:27.705262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105eb6-d3d5-45d8-9859-726f3a0899f7 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.705553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105eb6-d3d5-45d8-9859-726f3a0899f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.705838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52105eb6-d3d5-45d8-9859-726f3a0899f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.721240 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52105eb6-d3d5-45d8-9859-726f3a0899f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:27.723968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52105eb6-d3d5-45d8-9859-726f3a0899f7 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:27.738443 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1237/2452] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:27.754274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b71f4-4925-47ce-a280-a2304b555de8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:27.755979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b92b71f4-4925-47ce-a280-a2304b555de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:27.821315 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b71f4-4925-47ce-a280-a2304b555de8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:27.826179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b401a-1fbb-49c8-8751-1f535d6bdbb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:27.826873 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b401a-1fbb-49c8-8751-1f535d6bdbb4 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:27.827159 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b401a-1fbb-49c8-8751-1f535d6bdbb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:27.827448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b401a-1fbb-49c8-8751-1f535d6bdbb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:27.829596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d28b401a-1fbb-49c8-8751-1f535d6bdbb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:27.904594 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:27.927662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b401a-1fbb-49c8-8751-1f535d6bdbb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:27.929113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b401a-1fbb-49c8-8751-1f535d6bdbb4 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:27.949603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1216/2453] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:37.235418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105eb6-d3d5-45d8-9859-726f3a0899f7 service nova] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:37.309795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52105eb6-d3d5-45d8-9859-726f3a0899f7 service nova] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:37.315123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:37.316271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:37.316549 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:37.316824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] PATH_INFO: `/v3/users/2fef5799a5e443b382cfdebb9ec43c9c` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:37.319630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fef5799a5e443b382cfdebb9ec43c9c)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:37.323439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:37.373242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fef5799a5e443b382cfdebb9ec43c9c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.373897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fef5799a5e443b382cfdebb9ec43c9c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.374548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fef5799a5e443b382cfdebb9ec43c9c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.390962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fef5799a5e443b382cfdebb9ec43c9c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.398302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fef5799a5e443b382cfdebb9ec43c9c'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.418825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1238/2454] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:37 2022] DELETE /identity/v3/users/2fef5799a5e443b382cfdebb9ec43c9c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:37.421053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00cc96-aab5-4f0b-a178-3b1666aabb97 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:37.421564 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00cc96-aab5-4f0b-a178-3b1666aabb97 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:37.421790 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00cc96-aab5-4f0b-a178-3b1666aabb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:37.440922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8d00cc96-aab5-4f0b-a178-3b1666aabb97 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:37.442246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8d00cc96-aab5-4f0b-a178-3b1666aabb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:37.501453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1217/2455] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:37.511235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:37.513417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:37.524553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:37.575222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e6363-7b0f-4c62-8ac2-289ffeaaa2a9 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:37.579010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1a9a-8c84-47d5-98a5-95f37843ac4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:37.579654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1a9a-8c84-47d5-98a5-95f37843ac4b service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:37.579939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1a9a-8c84-47d5-98a5-95f37843ac4b service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:37.580219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1a9a-8c84-47d5-98a5-95f37843ac4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:37.589787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb1a9a-8c84-47d5-98a5-95f37843ac4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:37.591270 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb1a9a-8c84-47d5-98a5-95f37843ac4b service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:37.602015 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1239/2456] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:37.879277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00cc96-aab5-4f0b-a178-3b1666aabb97 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:37.880718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8d00cc96-aab5-4f0b-a178-3b1666aabb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:37.894099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00cc96-aab5-4f0b-a178-3b1666aabb97 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:37.898763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:37.899714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:37.900000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:37.900277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] PATH_INFO: `/v3/projects/5c99201bdc7f49a0bd87bc7fa1002f1b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:37.901612 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c99201bdc7f49a0bd87bc7fa1002f1b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:37.904778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:37.953348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c99201bdc7f49a0bd87bc7fa1002f1b', 'request_id': 'req-a26449f3-38dd-4a47-864c-6a584b64ff10'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.960519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c99201bdc7f49a0bd87bc7fa1002f1b', 'request_id': 'req-a26449f3-38dd-4a47-864c-6a584b64ff10'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.967375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c99201bdc7f49a0bd87bc7fa1002f1b', 'request_id': 'req-a26449f3-38dd-4a47-864c-6a584b64ff10'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.977682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] The token cache is being invalidate because project 5c99201bdc7f49a0bd87bc7fa1002f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:37.977970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.978646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a26449f3-38dd-4a47-864c-6a584b64ff10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:37.980923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1218/2457] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:37 2022] DELETE /identity/v3/projects/5c99201bdc7f49a0bd87bc7fa1002f1b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:37.985780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b9f84-d51a-4ecd-adf1-32585554beb8 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:37.986071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b9f84-d51a-4ecd-adf1-32585554beb8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:37.986378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b9f84-d51a-4ecd-adf1-32585554beb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.003764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-3f5b9f84-d51a-4ecd-adf1-32585554beb8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:38.004963 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3f5b9f84-d51a-4ecd-adf1-32585554beb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:38.068601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1240/2458] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:38.079777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb314-1a27-4921-aa56-5a63fe87b5c4 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.079777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb314-1a27-4921-aa56-5a63fe87b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.079777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb314-1a27-4921-aa56-5a63fe87b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.101361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-051bb314-1a27-4921-aa56-5a63fe87b5c4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:38.102685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-051bb314-1a27-4921-aa56-5a63fe87b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:38.113326 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1219/2459] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:38.117654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b9f84-d51a-4ecd-adf1-32585554beb8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.128130 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b9f84-d51a-4ecd-adf1-32585554beb8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.132755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc8da-feef-43b7-820e-c777a2ab6352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.133486 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc8da-feef-43b7-820e-c777a2ab6352 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.133767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc8da-feef-43b7-820e-c777a2ab6352 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.134124 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc8da-feef-43b7-820e-c777a2ab6352 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.135484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fc8da-feef-43b7-820e-c777a2ab6352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:00:38.135484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fc8da-feef-43b7-820e-c777a2ab6352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.137344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fc8da-feef-43b7-820e-c777a2ab6352 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.156387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1241/2460] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:00:38.160746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb314-1a27-4921-aa56-5a63fe87b5c4 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.171142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb314-1a27-4921-aa56-5a63fe87b5c4 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.176393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20252c3a-a7b7-4d63-89d0-b3fb1e36fef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.177086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20252c3a-a7b7-4d63-89d0-b3fb1e36fef1 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.177430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20252c3a-a7b7-4d63-89d0-b3fb1e36fef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.177898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20252c3a-a7b7-4d63-89d0-b3fb1e36fef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.178825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20252c3a-a7b7-4d63-89d0-b3fb1e36fef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.180817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20252c3a-a7b7-4d63-89d0-b3fb1e36fef1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.209046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1220/2461] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:38 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:38.217031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc8da-feef-43b7-820e-c777a2ab6352 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.235255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc8da-feef-43b7-820e-c777a2ab6352 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.303217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a0f89-70f4-4863-848b-32def8926a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.303923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a0f89-70f4-4863-848b-32def8926a59 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.304149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a0f89-70f4-4863-848b-32def8926a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.304425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a0f89-70f4-4863-848b-32def8926a59 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.305110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a0f89-70f4-4863-848b-32def8926a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.307066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a0f89-70f4-4863-848b-32def8926a59 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.331191 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1242/2462] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:38 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:38.335348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20252c3a-a7b7-4d63-89d0-b3fb1e36fef1 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.346673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20252c3a-a7b7-4d63-89d0-b3fb1e36fef1 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.351316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768e099-a5be-47ba-a2b2-5ba1a8a16f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.351976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768e099-a5be-47ba-a2b2-5ba1a8a16f03 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.352262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768e099-a5be-47ba-a2b2-5ba1a8a16f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.352542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768e099-a5be-47ba-a2b2-5ba1a8a16f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.353268 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768e099-a5be-47ba-a2b2-5ba1a8a16f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.354914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768e099-a5be-47ba-a2b2-5ba1a8a16f03 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.367088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1221/2463] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:38.371318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a0f89-70f4-4863-848b-32def8926a59 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.381711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a0f89-70f4-4863-848b-32def8926a59 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.386863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f105fd6-7072-4871-943a-ba3c0f619301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.387526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105fd6-7072-4871-943a-ba3c0f619301 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.387810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105fd6-7072-4871-943a-ba3c0f619301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.388089 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f105fd6-7072-4871-943a-ba3c0f619301 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.388813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f105fd6-7072-4871-943a-ba3c0f619301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.390484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f105fd6-7072-4871-943a-ba3c0f619301 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.400898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1243/2464] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:38.405866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768e099-a5be-47ba-a2b2-5ba1a8a16f03 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.416112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768e099-a5be-47ba-a2b2-5ba1a8a16f03 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.420970 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310fad-439a-4c58-81f9-6507dd6330a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.421887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310fad-439a-4c58-81f9-6507dd6330a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.422457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310fad-439a-4c58-81f9-6507dd6330a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.422457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310fad-439a-4c58-81f9-6507dd6330a1 admin admin] PATH_INFO: `/v3/projects/775649283ec2460cb239a8776f10b17d/users/8ad413c9faed46c9a32cd23e53e670c9/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.434408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:38.439819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a310fad-439a-4c58-81f9-6507dd6330a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775649283ec2460cb239a8776f10b17d, user_id=8ad413c9faed46c9a32cd23e53e670c9, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.446362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a310fad-439a-4c58-81f9-6507dd6330a1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.461051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1222/2465] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:38 2022] PUT /identity/v3/projects/775649283ec2460cb239a8776f10b17d/users/8ad413c9faed46c9a32cd23e53e670c9/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:38.472102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98035def-7fb2-4379-b72f-18b3c571f399 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.472593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98035def-7fb2-4379-b72f-18b3c571f399 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.472894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98035def-7fb2-4379-b72f-18b3c571f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.508115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-98035def-7fb2-4379-b72f-18b3c571f399 None None] MFA Rules not processed for user `8ad413c9faed46c9a32cd23e53e670c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:38.509521 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-98035def-7fb2-4379-b72f-18b3c571f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:38.516004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:38.541804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310fad-439a-4c58-81f9-6507dd6330a1 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.543851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0a310fad-439a-4c58-81f9-6507dd6330a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:38.590812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1244/2466] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:38.595199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98035def-7fb2-4379-b72f-18b3c571f399 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.616126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310fad-439a-4c58-81f9-6507dd6330a1 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.619815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf0983-3fca-4190-af93-43156993b4e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.620493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf0983-3fca-4190-af93-43156993b4e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.620801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf0983-3fca-4190-af93-43156993b4e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.622482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf0983-3fca-4190-af93-43156993b4e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.623948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-21cf0983-3fca-4190-af93-43156993b4e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:38.661590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98035def-7fb2-4379-b72f-18b3c571f399 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.672327 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765c3c-2153-4f83-8a10-093f2ac9e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.673002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765c3c-2153-4f83-8a10-093f2ac9e98d admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.673283 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765c3c-2153-4f83-8a10-093f2ac9e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.673563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765c3c-2153-4f83-8a10-093f2ac9e98d admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.674373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0765c3c-2153-4f83-8a10-093f2ac9e98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.676312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0765c3c-2153-4f83-8a10-093f2ac9e98d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.694893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf0983-3fca-4190-af93-43156993b4e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.696851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf0983-3fca-4190-af93-43156993b4e0 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.705599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1245/2467] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:38 2022] POST /identity/v3/projects => generated 361 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:00:38.708629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1223/2468] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:38.709768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765c3c-2153-4f83-8a10-093f2ac9e98d admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.785079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765c3c-2153-4f83-8a10-093f2ac9e98d admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.790009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79216343-cf15-4988-a713-43032b8d6d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.790817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216343-cf15-4988-a713-43032b8d6d02 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.791094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216343-cf15-4988-a713-43032b8d6d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.791373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216343-cf15-4988-a713-43032b8d6d02 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.792071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79216343-cf15-4988-a713-43032b8d6d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.794767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79216343-cf15-4988-a713-43032b8d6d02 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.817539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1246/2469] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:38 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:00:38.821572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf0983-3fca-4190-af93-43156993b4e0 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.833020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf0983-3fca-4190-af93-43156993b4e0 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.837713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49847db-ab27-43f1-a4a3-a42f14a2170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.838412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49847db-ab27-43f1-a4a3-a42f14a2170c admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.838698 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49847db-ab27-43f1-a4a3-a42f14a2170c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.838978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49847db-ab27-43f1-a4a3-a42f14a2170c admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.840254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49847db-ab27-43f1-a4a3-a42f14a2170c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.841884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49847db-ab27-43f1-a4a3-a42f14a2170c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.855527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1224/2470] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:00:38.856710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79216343-cf15-4988-a713-43032b8d6d02 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.867085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79216343-cf15-4988-a713-43032b8d6d02 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.872661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0450c7-77e1-42aa-aadd-a586baba42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.873565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0450c7-77e1-42aa-aadd-a586baba42e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.873851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0450c7-77e1-42aa-aadd-a586baba42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.874135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0450c7-77e1-42aa-aadd-a586baba42e6 admin admin] PATH_INFO: `/v3/projects/504c3c39c375444cabe0b4079e038598/users/1288b023c6fa494dace75ac6a3c3b39c/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.891088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0450c7-77e1-42aa-aadd-a586baba42e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504c3c39c375444cabe0b4079e038598, user_id=1288b023c6fa494dace75ac6a3c3b39c, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.893773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0450c7-77e1-42aa-aadd-a586baba42e6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:38.902979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:38.911079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1247/2471] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:38 2022] PUT /identity/v3/projects/504c3c39c375444cabe0b4079e038598/users/1288b023c6fa494dace75ac6a3c3b39c/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:38.914907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49847db-ab27-43f1-a4a3-a42f14a2170c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:38.925764 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49847db-ab27-43f1-a4a3-a42f14a2170c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:38.987770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb0ac3-c11e-46ec-87ec-1aee9fe2d34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:38.988340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb0ac3-c11e-46ec-87ec-1aee9fe2d34d admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:38.988624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb0ac3-c11e-46ec-87ec-1aee9fe2d34d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:38.988901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb0ac3-c11e-46ec-87ec-1aee9fe2d34d admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:38.989626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb0ac3-c11e-46ec-87ec-1aee9fe2d34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:38.991339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb0ac3-c11e-46ec-87ec-1aee9fe2d34d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:39.002577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1225/2472] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:39.006597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0450c7-77e1-42aa-aadd-a586baba42e6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:39.017649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0450c7-77e1-42aa-aadd-a586baba42e6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:39.022391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70c74-c2d9-4122-8c19-be366fdf72b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:39.023277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70c74-c2d9-4122-8c19-be366fdf72b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:39.023561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70c74-c2d9-4122-8c19-be366fdf72b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:39.023841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70c74-c2d9-4122-8c19-be366fdf72b1 admin admin] PATH_INFO: `/v3/projects/504c3c39c375444cabe0b4079e038598/users/1288b023c6fa494dace75ac6a3c3b39c/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:39.025875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70c74-c2d9-4122-8c19-be366fdf72b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504c3c39c375444cabe0b4079e038598, user_id=1288b023c6fa494dace75ac6a3c3b39c, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:39.028623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70c74-c2d9-4122-8c19-be366fdf72b1 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:39.039455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1248/2473] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:39 2022] PUT /identity/v3/projects/504c3c39c375444cabe0b4079e038598/users/1288b023c6fa494dace75ac6a3c3b39c/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:39.049842 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796bf3-bd1d-4cec-bbaf-2d35cb16baa2 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:39.050155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796bf3-bd1d-4cec-bbaf-2d35cb16baa2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:39.050481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a796bf3-bd1d-4cec-bbaf-2d35cb16baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:39.080575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3a796bf3-bd1d-4cec-bbaf-2d35cb16baa2 None None] MFA Rules not processed for user `1288b023c6fa494dace75ac6a3c3b39c`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:39.081800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3a796bf3-bd1d-4cec-bbaf-2d35cb16baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:39.098935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:39.169551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1226/2474] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:39 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:39.182398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70c74-c2d9-4122-8c19-be366fdf72b1 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:39.184266 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b0a70c74-c2d9-4122-8c19-be366fdf72b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:39.253206 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70c74-c2d9-4122-8c19-be366fdf72b1 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:39.257045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb29d0e-9330-456a-89e3-b9695a214121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:39.257702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29d0e-9330-456a-89e3-b9695a214121 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:39.257984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29d0e-9330-456a-89e3-b9695a214121 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:39.258262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29d0e-9330-456a-89e3-b9695a214121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:39.271382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb29d0e-9330-456a-89e3-b9695a214121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:39.272876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb29d0e-9330-456a-89e3-b9695a214121 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:39.287781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1249/2475] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:39 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:39.732422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796bf3-bd1d-4cec-bbaf-2d35cb16baa2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:39.816458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a796bf3-bd1d-4cec-bbaf-2d35cb16baa2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:39.821393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:39.822333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:39.822619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:39.822908 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] PATH_INFO: `/v3/users/8ad413c9faed46c9a32cd23e53e670c9` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:39.824894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad413c9faed46c9a32cd23e53e670c9)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:39.827136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:39.884089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad413c9faed46c9a32cd23e53e670c9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:39.884748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad413c9faed46c9a32cd23e53e670c9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:39.898797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad413c9faed46c9a32cd23e53e670c9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:39.907372 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad413c9faed46c9a32cd23e53e670c9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:39.915871 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad413c9faed46c9a32cd23e53e670c9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:39.923428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1227/2476] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:39 2022] DELETE /identity/v3/users/8ad413c9faed46c9a32cd23e53e670c9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:39.928128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b07c-cea1-42e5-9643-05384202e90d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:39.928645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b07c-cea1-42e5-9643-05384202e90d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:39.929078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b07c-cea1-42e5-9643-05384202e90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:39.949678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-cb62b07c-cea1-42e5-9643-05384202e90d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:39.950978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-cb62b07c-cea1-42e5-9643-05384202e90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:40.016099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1250/2477] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:40.025903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:40.027411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:40.064859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:40.104966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d2e0-393f-4808-925b-945fc7512d0b admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:40.109995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41f269-4774-47e0-b2b6-4c7793a27eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:40.110682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41f269-4774-47e0-b2b6-4c7793a27eee service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:40.110964 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41f269-4774-47e0-b2b6-4c7793a27eee service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:40.111273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41f269-4774-47e0-b2b6-4c7793a27eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:40.122468 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41f269-4774-47e0-b2b6-4c7793a27eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:40.124286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41f269-4774-47e0-b2b6-4c7793a27eee service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:40.139984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1228/2478] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:40.493952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b07c-cea1-42e5-9643-05384202e90d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:40.495735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-cb62b07c-cea1-42e5-9643-05384202e90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:40.529954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b07c-cea1-42e5-9643-05384202e90d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:40.542341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:40.544256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:40.544629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:40.544990 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] PATH_INFO: `/v3/projects/775649283ec2460cb239a8776f10b17d` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:40.546863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=775649283ec2460cb239a8776f10b17d)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:40.552600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:40.633618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775649283ec2460cb239a8776f10b17d', 'request_id': 'req-6a4b471d-243a-4bd6-844e-e88dd4166e62'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.644179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775649283ec2460cb239a8776f10b17d', 'request_id': 'req-6a4b471d-243a-4bd6-844e-e88dd4166e62'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.653253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775649283ec2460cb239a8776f10b17d', 'request_id': 'req-6a4b471d-243a-4bd6-844e-e88dd4166e62'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.671105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] The token cache is being invalidate because project 775649283ec2460cb239a8776f10b17d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:40.671398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.672055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.673822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1251/2479] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:40 2022] DELETE /identity/v3/projects/775649283ec2460cb239a8776f10b17d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:40.677619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41f269-4774-47e0-b2b6-4c7793a27eee service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:40.688147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41f269-4774-47e0-b2b6-4c7793a27eee service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:40.772130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:40.772994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:40.773276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:40.773553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] PATH_INFO: `/v3/users/1288b023c6fa494dace75ac6a3c3b39c` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:40.774963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1288b023c6fa494dace75ac6a3c3b39c)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:40.777599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:40.866966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1288b023c6fa494dace75ac6a3c3b39c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.868156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1288b023c6fa494dace75ac6a3c3b39c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.889689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1288b023c6fa494dace75ac6a3c3b39c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.897874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1288b023c6fa494dace75ac6a3c3b39c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.907676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-cc087c6c-5b62-4da2-b74e-6d937b788255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1288b023c6fa494dace75ac6a3c3b39c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:40.922053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1229/2480] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:40 2022] DELETE /identity/v3/users/1288b023c6fa494dace75ac6a3c3b39c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:41.257280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:41.264537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:41.298221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b471d-243a-4bd6-844e-e88dd4166e62 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:41.314920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:41.379973 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:41.380946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:41.381296 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:41.381643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] PATH_INFO: `/v3/projects/504c3c39c375444cabe0b4079e038598` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:41.382966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=504c3c39c375444cabe0b4079e038598)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:41.384980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:41.446303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504c3c39c375444cabe0b4079e038598', 'request_id': 'req-093b08b0-d45a-4092-ac57-fc43f7d792fc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:41.455863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504c3c39c375444cabe0b4079e038598', 'request_id': 'req-093b08b0-d45a-4092-ac57-fc43f7d792fc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:41.462621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504c3c39c375444cabe0b4079e038598', 'request_id': 'req-093b08b0-d45a-4092-ac57-fc43f7d792fc'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:41.475678 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] The token cache is being invalidate because project 504c3c39c375444cabe0b4079e038598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:41.475978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:41.476737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-093b08b0-d45a-4092-ac57-fc43f7d792fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:41.481935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1252/2481] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:41 2022] DELETE /identity/v3/projects/504c3c39c375444cabe0b4079e038598 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:00:41.483767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465691-214c-4af6-b3fb-dac42a592621 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:41.484065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465691-214c-4af6-b3fb-dac42a592621 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:41.484381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465691-214c-4af6-b3fb-dac42a592621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:41.504726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d0465691-214c-4af6-b3fb-dac42a592621 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:41.506241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d0465691-214c-4af6-b3fb-dac42a592621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:41.569668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:41.591003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1230/2482] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:41.599971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1929c2-2349-4819-b07c-f7fc6a17324a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:41.600551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1929c2-2349-4819-b07c-f7fc6a17324a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:41.601118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1929c2-2349-4819-b07c-f7fc6a17324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:41.636810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-be1929c2-2349-4819-b07c-f7fc6a17324a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:41.639263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-be1929c2-2349-4819-b07c-f7fc6a17324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:41.660646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1253/2483] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:00:41.665247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0465691-214c-4af6-b3fb-dac42a592621 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:41.681194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0465691-214c-4af6-b3fb-dac42a592621 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:41.687582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247636d9-19e7-48f9-8eb1-bd58fb57a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:41.688281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247636d9-19e7-48f9-8eb1-bd58fb57a1ba admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:41.688567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247636d9-19e7-48f9-8eb1-bd58fb57a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:41.688846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247636d9-19e7-48f9-8eb1-bd58fb57a1ba admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:41.689596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247636d9-19e7-48f9-8eb1-bd58fb57a1ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:00:41.689907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247636d9-19e7-48f9-8eb1-bd58fb57a1ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:41.691618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247636d9-19e7-48f9-8eb1-bd58fb57a1ba admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:41.713130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1231/2484] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:00:41.720575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1929c2-2349-4819-b07c-f7fc6a17324a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:41.732487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1929c2-2349-4819-b07c-f7fc6a17324a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:41.746445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb916c5-1111-43a9-a7f3-08554cd22f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:41.747348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb916c5-1111-43a9-a7f3-08554cd22f25 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:41.747752 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb916c5-1111-43a9-a7f3-08554cd22f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:41.748104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb916c5-1111-43a9-a7f3-08554cd22f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:41.748898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb916c5-1111-43a9-a7f3-08554cd22f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:41.751057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb916c5-1111-43a9-a7f3-08554cd22f25 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:41.798215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1254/2485] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:41 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:41.804035 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247636d9-19e7-48f9-8eb1-bd58fb57a1ba admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:41.832025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247636d9-19e7-48f9-8eb1-bd58fb57a1ba admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:41.916035 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5977dac-8ccf-4104-9ada-a32e81d92cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:41.916718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5977dac-8ccf-4104-9ada-a32e81d92cfd admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:41.917005 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5977dac-8ccf-4104-9ada-a32e81d92cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:41.917284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5977dac-8ccf-4104-9ada-a32e81d92cfd admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:41.919220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5977dac-8ccf-4104-9ada-a32e81d92cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:41.921229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5977dac-8ccf-4104-9ada-a32e81d92cfd admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:41.948484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1232/2486] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:41 2022] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:41.952602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb916c5-1111-43a9-a7f3-08554cd22f25 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:41.966791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb916c5-1111-43a9-a7f3-08554cd22f25 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:41.972043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9194856-1c21-4e6e-9aa0-aabfa89e9c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:41.972785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9194856-1c21-4e6e-9aa0-aabfa89e9c98 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:41.973251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9194856-1c21-4e6e-9aa0-aabfa89e9c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:41.973753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9194856-1c21-4e6e-9aa0-aabfa89e9c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:41.974759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9194856-1c21-4e6e-9aa0-aabfa89e9c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:41.976704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9194856-1c21-4e6e-9aa0-aabfa89e9c98 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:41.992833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1255/2487] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:00:41.997486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5977dac-8ccf-4104-9ada-a32e81d92cfd admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.009525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5977dac-8ccf-4104-9ada-a32e81d92cfd admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.017492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a5c34-f0b5-46eb-8380-4658848eae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.018124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a5c34-f0b5-46eb-8380-4658848eae10 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.018460 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a5c34-f0b5-46eb-8380-4658848eae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.019237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a5c34-f0b5-46eb-8380-4658848eae10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.020150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a5c34-f0b5-46eb-8380-4658848eae10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.024819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a5c34-f0b5-46eb-8380-4658848eae10 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.059705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1233/2488] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:42.064095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9194856-1c21-4e6e-9aa0-aabfa89e9c98 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.087639 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9194856-1c21-4e6e-9aa0-aabfa89e9c98 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.093535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9486-2582-4af1-9447-5b34d6f94688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.094832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9486-2582-4af1-9447-5b34d6f94688 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.095265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9486-2582-4af1-9447-5b34d6f94688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.095876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9486-2582-4af1-9447-5b34d6f94688 admin admin] PATH_INFO: `/v3/projects/5f8984c20dfc496982cfda8a54b0db9c/users/e9acb3177d2f488988001d25393e5977/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.120782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9486-2582-4af1-9447-5b34d6f94688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8984c20dfc496982cfda8a54b0db9c, user_id=e9acb3177d2f488988001d25393e5977, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.123995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9486-2582-4af1-9447-5b34d6f94688 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.163349 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1256/2489] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:42 2022] PUT /identity/v3/projects/5f8984c20dfc496982cfda8a54b0db9c/users/e9acb3177d2f488988001d25393e5977/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:42.175859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b667b-945b-468f-bf35-033c4eacb38b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.177189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b667b-945b-468f-bf35-033c4eacb38b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.177189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b667b-945b-468f-bf35-033c4eacb38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.208633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f49b667b-945b-468f-bf35-033c4eacb38b None None] MFA Rules not processed for user `e9acb3177d2f488988001d25393e5977`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:42.209643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f49b667b-945b-468f-bf35-033c4eacb38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.311297 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1234/2490] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:42.316808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9486-2582-4af1-9447-5b34d6f94688 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.357810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b667b-945b-468f-bf35-033c4eacb38b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.359405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f49b667b-945b-468f-bf35-033c4eacb38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.369428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:42.399714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9486-2582-4af1-9447-5b34d6f94688 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.404581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792b5ad-f47c-4bb3-9d8b-0b7f9b6f3349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.405238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b5ad-f47c-4bb3-9d8b-0b7f9b6f3349 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.405537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b5ad-f47c-4bb3-9d8b-0b7f9b6f3349 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.405797 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b5ad-f47c-4bb3-9d8b-0b7f9b6f3349 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.406537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792b5ad-f47c-4bb3-9d8b-0b7f9b6f3349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.408444 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792b5ad-f47c-4bb3-9d8b-0b7f9b6f3349 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.432875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:42.449659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1257/2491] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:42 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:00:42.450771 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792b5ad-f47c-4bb3-9d8b-0b7f9b6f3349 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.456513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b667b-945b-468f-bf35-033c4eacb38b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.521025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.521294 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792b5ad-f47c-4bb3-9d8b-0b7f9b6f3349 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.521402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.521402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.521402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] PATH_INFO: `/v3/users/b0b95c321c4a452faa81a93168c7bf0a` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.521402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b95c321c4a452faa81a93168c7bf0a)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.522127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.526087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0081-a294-4ec6-b1b5-566294662693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.527356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0081-a294-4ec6-b1b5-566294662693 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.527703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0081-a294-4ec6-b1b5-566294662693 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.528029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b0081-a294-4ec6-b1b5-566294662693 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.529239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b0081-a294-4ec6-b1b5-566294662693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.530873 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b0081-a294-4ec6-b1b5-566294662693 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.559017 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1258/2492] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:42 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:00:42.561439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0081-a294-4ec6-b1b5-566294662693 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.572325 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b0081-a294-4ec6-b1b5-566294662693 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.579422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b8db3-3311-4fe2-bb54-ccc7eab1314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.580324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b8db3-3311-4fe2-bb54-ccc7eab1314a admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.581964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b8db3-3311-4fe2-bb54-ccc7eab1314a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.581964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b8db3-3311-4fe2-bb54-ccc7eab1314a admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.582308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b8db3-3311-4fe2-bb54-ccc7eab1314a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.583857 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b95c321c4a452faa81a93168c7bf0a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.584022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b8db3-3311-4fe2-bb54-ccc7eab1314a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.584580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b95c321c4a452faa81a93168c7bf0a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.598384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1259/2493] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:42.600190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b95c321c4a452faa81a93168c7bf0a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.600909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b8db3-3311-4fe2-bb54-ccc7eab1314a admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.602898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-270b8db3-3311-4fe2-bb54-ccc7eab1314a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.615085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b95c321c4a452faa81a93168c7bf0a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.617181 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b8db3-3311-4fe2-bb54-ccc7eab1314a admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.623944 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4df555-94c8-426b-ade7-bb96194d38c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.624778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b95c321c4a452faa81a93168c7bf0a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.624985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4df555-94c8-426b-ade7-bb96194d38c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.625278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4df555-94c8-426b-ade7-bb96194d38c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.625561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4df555-94c8-426b-ade7-bb96194d38c0 admin admin] PATH_INFO: `/v3/projects/b95565e3cdf0486d9fd9b97a72f8f80e/users/662842e704c548879c78b40a06b785d9/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.631994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1235/2494] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:42 2022] DELETE /identity/v3/users/b0b95c321c4a452faa81a93168c7bf0a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:00:42.643556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4df555-94c8-426b-ade7-bb96194d38c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95565e3cdf0486d9fd9b97a72f8f80e, user_id=662842e704c548879c78b40a06b785d9, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.646286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4df555-94c8-426b-ade7-bb96194d38c0 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.664716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1260/2495] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:42 2022] PUT /identity/v3/projects/b95565e3cdf0486d9fd9b97a72f8f80e/users/662842e704c548879c78b40a06b785d9/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:00:42.669270 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.738400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d713901-7309-40eb-9f63-7e02df6e9bdf admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.756343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:42.802493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22866f55-2626-4ae9-8869-50d2ec1f9cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.803452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866f55-2626-4ae9-8869-50d2ec1f9cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.803746 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866f55-2626-4ae9-8869-50d2ec1f9cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.804030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866f55-2626-4ae9-8869-50d2ec1f9cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.804879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22866f55-2626-4ae9-8869-50d2ec1f9cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.806789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22866f55-2626-4ae9-8869-50d2ec1f9cc2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.818803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1236/2496] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:42.823539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22866f55-2626-4ae9-8869-50d2ec1f9cc2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.824730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4df555-94c8-426b-ade7-bb96194d38c0 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.826821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-5b4df555-94c8-426b-ade7-bb96194d38c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.837893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22866f55-2626-4ae9-8869-50d2ec1f9cc2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.846069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665963e-e5ee-4470-83fb-54729c02d5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.847096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665963e-e5ee-4470-83fb-54729c02d5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.847313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665963e-e5ee-4470-83fb-54729c02d5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.847643 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665963e-e5ee-4470-83fb-54729c02d5d3 admin admin] PATH_INFO: `/v3/projects/b95565e3cdf0486d9fd9b97a72f8f80e/users/662842e704c548879c78b40a06b785d9/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.848596 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4df555-94c8-426b-ade7-bb96194d38c0 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:42.849859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665963e-e5ee-4470-83fb-54729c02d5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95565e3cdf0486d9fd9b97a72f8f80e, user_id=662842e704c548879c78b40a06b785d9, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.852457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665963e-e5ee-4470-83fb-54729c02d5d3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.855546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:42.856777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.857204 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.857604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] PATH_INFO: `/v3/projects/11861d35a3444734be8870f47cce1b9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.859384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=11861d35a3444734be8870f47cce1b9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:42.862751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:42.864431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1237/2497] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:42 2022] PUT /identity/v3/projects/b95565e3cdf0486d9fd9b97a72f8f80e/users/662842e704c548879c78b40a06b785d9/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:00:42.876626 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456dae-44a2-4fe4-a848-27e1c340e5fa None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.877057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456dae-44a2-4fe4-a848-27e1c340e5fa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.877345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67456dae-44a2-4fe4-a848-27e1c340e5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.905884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-67456dae-44a2-4fe4-a848-27e1c340e5fa None None] MFA Rules not processed for user `662842e704c548879c78b40a06b785d9`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:42.907206 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-67456dae-44a2-4fe4-a848-27e1c340e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.919496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11861d35a3444734be8870f47cce1b9b', 'request_id': 'req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.927746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11861d35a3444734be8870f47cce1b9b', 'request_id': 'req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.935097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11861d35a3444734be8870f47cce1b9b', 'request_id': 'req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.942645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:42.946774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] The token cache is being invalidate because project 11861d35a3444734be8870f47cce1b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:42.947238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.948764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0e3a5dfa-f652-4e2a-a50e-d33fb96925eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:42.950933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1261/2498] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:42 2022] DELETE /identity/v3/projects/11861d35a3444734be8870f47cce1b9b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:42.955675 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78595-3620-412c-9991-cf19c39e7169 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:42.956039 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78595-3620-412c-9991-cf19c39e7169 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:42.956387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78595-3620-412c-9991-cf19c39e7169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:42.975071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a3b78595-3620-412c-9991-cf19c39e7169 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:42.976364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a3b78595-3620-412c-9991-cf19c39e7169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:42.983503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1238/2499] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:00:42.995521 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456dae-44a2-4fe4-a848-27e1c340e5fa None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:42.998077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-67456dae-44a2-4fe4-a848-27e1c340e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:43.038199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1262/2500] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:00:43.047739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3609de-6de2-4437-aadc-fd2308ee06e4 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.048039 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3609de-6de2-4437-aadc-fd2308ee06e4 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.048326 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3609de-6de2-4437-aadc-fd2308ee06e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.056174 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67456dae-44a2-4fe4-a848-27e1c340e5fa None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.060928 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfed8b-acf6-47a8-8925-0eb91bcb1546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.061565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfed8b-acf6-47a8-8925-0eb91bcb1546 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.061848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfed8b-acf6-47a8-8925-0eb91bcb1546 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.062133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfed8b-acf6-47a8-8925-0eb91bcb1546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.067021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0d3609de-6de2-4437-aadc-fd2308ee06e4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:43.068355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0d3609de-6de2-4437-aadc-fd2308ee06e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:43.071480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfed8b-acf6-47a8-8925-0eb91bcb1546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.072917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfed8b-acf6-47a8-8925-0eb91bcb1546 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.077046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1263/2501] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:00:43.081463 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3609de-6de2-4437-aadc-fd2308ee06e4 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.083325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1239/2502] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:43.090810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3609de-6de2-4437-aadc-fd2308ee06e4 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.095540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d0a1a-3ade-486d-95b0-d61c3ec4c2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.096190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d0a1a-3ade-486d-95b0-d61c3ec4c2fa admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.096472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d0a1a-3ade-486d-95b0-d61c3ec4c2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.096746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d0a1a-3ade-486d-95b0-d61c3ec4c2fa admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.097465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d0a1a-3ade-486d-95b0-d61c3ec4c2fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:00:43.097773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d0a1a-3ade-486d-95b0-d61c3ec4c2fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.099425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d0a1a-3ade-486d-95b0-d61c3ec4c2fa admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.112737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1264/2503] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:00:43.116834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfed8b-acf6-47a8-8925-0eb91bcb1546 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.128120 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfed8b-acf6-47a8-8925-0eb91bcb1546 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.132753 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015911b-859d-4d7d-acb8-c986cd4249ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.133398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015911b-859d-4d7d-acb8-c986cd4249ed admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.133681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015911b-859d-4d7d-acb8-c986cd4249ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.133958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015911b-859d-4d7d-acb8-c986cd4249ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.134766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015911b-859d-4d7d-acb8-c986cd4249ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.137526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015911b-859d-4d7d-acb8-c986cd4249ed admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.158498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d0a1a-3ade-486d-95b0-d61c3ec4c2fa admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.168769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1240/2504] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:43 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:00:43.173043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015911b-859d-4d7d-acb8-c986cd4249ed admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.175452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d0a1a-3ade-486d-95b0-d61c3ec4c2fa admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.182633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:43.227864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc63b2-74af-480a-a07e-2fce2d9b18b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.228520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc63b2-74af-480a-a07e-2fce2d9b18b3 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.228812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc63b2-74af-480a-a07e-2fce2d9b18b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.229097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc63b2-74af-480a-a07e-2fce2d9b18b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.231589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e6bc63b2-74af-480a-a07e-2fce2d9b18b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:43.239295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015911b-859d-4d7d-acb8-c986cd4249ed admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.245108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7336-a70a-4efa-a54f-db3879c2bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.245950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7336-a70a-4efa-a54f-db3879c2bcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.246242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7336-a70a-4efa-a54f-db3879c2bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.246605 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7336-a70a-4efa-a54f-db3879c2bcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.247311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f7336-a70a-4efa-a54f-db3879c2bcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.249332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f7336-a70a-4efa-a54f-db3879c2bcf8 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.272402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1241/2505] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:43 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:00:43.273505 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7336-a70a-4efa-a54f-db3879c2bcf8 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.284065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7336-a70a-4efa-a54f-db3879c2bcf8 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.289168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f57a2-87ba-403b-a1fa-c4532c7e59c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.289898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f57a2-87ba-403b-a1fa-c4532c7e59c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.290219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f57a2-87ba-403b-a1fa-c4532c7e59c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.290545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f57a2-87ba-403b-a1fa-c4532c7e59c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.291322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f57a2-87ba-403b-a1fa-c4532c7e59c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.293872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f57a2-87ba-403b-a1fa-c4532c7e59c0 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.295897 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc63b2-74af-480a-a07e-2fce2d9b18b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.297340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc63b2-74af-480a-a07e-2fce2d9b18b3 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.304378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1242/2506] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:43.306841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1265/2507] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:43 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:43.308891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f57a2-87ba-403b-a1fa-c4532c7e59c0 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.319221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f57a2-87ba-403b-a1fa-c4532c7e59c0 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.324986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3350bb-9b35-44df-8121-e3c166da188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.325651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3350bb-9b35-44df-8121-e3c166da188d admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.325943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3350bb-9b35-44df-8121-e3c166da188d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.326219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3350bb-9b35-44df-8121-e3c166da188d admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.327003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3350bb-9b35-44df-8121-e3c166da188d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.328891 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3350bb-9b35-44df-8121-e3c166da188d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.340796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1243/2508] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:00:43.344651 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc63b2-74af-480a-a07e-2fce2d9b18b3 service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.355993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc63b2-74af-480a-a07e-2fce2d9b18b3 service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.361790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b39e5-efd5-4b9a-879b-604142b604b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.362709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b39e5-efd5-4b9a-879b-604142b604b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.363014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b39e5-efd5-4b9a-879b-604142b604b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.363278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b39e5-efd5-4b9a-879b-604142b604b8 admin admin] PATH_INFO: `/v3/projects/2e7a502db42a4bac8d712ce3d60de9bd/users/d33755a6ac984564ad29a3288c7a8952/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.380392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b39e5-efd5-4b9a-879b-604142b604b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7a502db42a4bac8d712ce3d60de9bd, user_id=d33755a6ac984564ad29a3288c7a8952, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.383251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b39e5-efd5-4b9a-879b-604142b604b8 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.398325 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1266/2509] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:43 2022] PUT /identity/v3/projects/2e7a502db42a4bac8d712ce3d60de9bd/users/d33755a6ac984564ad29a3288c7a8952/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:43.409338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b285-18bd-445d-98fe-1f1d5a5426b6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.409635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b285-18bd-445d-98fe-1f1d5a5426b6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.409945 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b285-18bd-445d-98fe-1f1d5a5426b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.442224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-9e76b285-18bd-445d-98fe-1f1d5a5426b6 None None] MFA Rules not processed for user `d33755a6ac984564ad29a3288c7a8952`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:43.444137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9e76b285-18bd-445d-98fe-1f1d5a5426b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:43.529585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1244/2510] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:43.534373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b39e5-efd5-4b9a-879b-604142b604b8 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.549702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:43.605529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b39e5-efd5-4b9a-879b-604142b604b8 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.610761 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d470-0981-49f4-9975-8941b856d620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.611445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d470-0981-49f4-9975-8941b856d620 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.611730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d470-0981-49f4-9975-8941b856d620 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.612009 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d470-0981-49f4-9975-8941b856d620 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.612723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d470-0981-49f4-9975-8941b856d620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.614699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d470-0981-49f4-9975-8941b856d620 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.648377 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1267/2511] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:43 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:43.650057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76b285-18bd-445d-98fe-1f1d5a5426b6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.663204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76b285-18bd-445d-98fe-1f1d5a5426b6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.726967 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c31832-9d5e-4f2f-870e-6c404a81c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.727667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c31832-9d5e-4f2f-870e-6c404a81c60f admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.728311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c31832-9d5e-4f2f-870e-6c404a81c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.728311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c31832-9d5e-4f2f-870e-6c404a81c60f admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.728898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c31832-9d5e-4f2f-870e-6c404a81c60f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.731513 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c31832-9d5e-4f2f-870e-6c404a81c60f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.741438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:43.755659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1245/2512] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:43 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:00:43.759719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d470-0981-49f4-9975-8941b856d620 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.770543 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d470-0981-49f4-9975-8941b856d620 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.775361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499837d-e326-4c60-aafc-70a8c05fe66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.776019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499837d-e326-4c60-aafc-70a8c05fe66e admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.776302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499837d-e326-4c60-aafc-70a8c05fe66e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.776580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499837d-e326-4c60-aafc-70a8c05fe66e admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.777365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499837d-e326-4c60-aafc-70a8c05fe66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.779005 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499837d-e326-4c60-aafc-70a8c05fe66e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.790220 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1268/2513] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:43.795761 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c31832-9d5e-4f2f-870e-6c404a81c60f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.805943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c31832-9d5e-4f2f-870e-6c404a81c60f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.811884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78c546-1f2c-4cbd-827c-2284e3d58a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.812772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78c546-1f2c-4cbd-827c-2284e3d58a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.813062 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78c546-1f2c-4cbd-827c-2284e3d58a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.813343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78c546-1f2c-4cbd-827c-2284e3d58a12 admin admin] PATH_INFO: `/v3/projects/7c14ab5c24024d6b9a4b36347ef7367c/users/e352e983ce124083813a9de8561a3616/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.830582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78c546-1f2c-4cbd-827c-2284e3d58a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c14ab5c24024d6b9a4b36347ef7367c, user_id=e352e983ce124083813a9de8561a3616, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.833273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78c546-1f2c-4cbd-827c-2284e3d58a12 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.850475 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1246/2514] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:43 2022] PUT /identity/v3/projects/7c14ab5c24024d6b9a4b36347ef7367c/users/e352e983ce124083813a9de8561a3616/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:43.856099 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499837d-e326-4c60-aafc-70a8c05fe66e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.866638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499837d-e326-4c60-aafc-70a8c05fe66e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.924517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a5266-2c86-4d9e-854c-8c8ca40a3528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.925189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5266-2c86-4d9e-854c-8c8ca40a3528 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.925478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5266-2c86-4d9e-854c-8c8ca40a3528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.925754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5266-2c86-4d9e-854c-8c8ca40a3528 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.926514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a5266-2c86-4d9e-854c-8c8ca40a3528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.928113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a5266-2c86-4d9e-854c-8c8ca40a3528 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.939697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1269/2515] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:43.943887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78c546-1f2c-4cbd-827c-2284e3d58a12 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:43.955241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78c546-1f2c-4cbd-827c-2284e3d58a12 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:43.965994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de8a2-61a3-49e1-96cd-b97c7ac1b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:43.966962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de8a2-61a3-49e1-96cd-b97c7ac1b53c admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.967247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de8a2-61a3-49e1-96cd-b97c7ac1b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.967526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de8a2-61a3-49e1-96cd-b97c7ac1b53c admin admin] PATH_INFO: `/v3/projects/7c14ab5c24024d6b9a4b36347ef7367c/users/e352e983ce124083813a9de8561a3616/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:43.969802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de8a2-61a3-49e1-96cd-b97c7ac1b53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c14ab5c24024d6b9a4b36347ef7367c, user_id=e352e983ce124083813a9de8561a3616, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:43.972528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de8a2-61a3-49e1-96cd-b97c7ac1b53c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:43.984056 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1247/2516] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:43 2022] PUT /identity/v3/projects/7c14ab5c24024d6b9a4b36347ef7367c/users/e352e983ce124083813a9de8561a3616/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:00:43.994388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69042cd-ccc5-4f4d-b623-93712a7a3fde None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:43.994687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69042cd-ccc5-4f4d-b623-93712a7a3fde None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:43.994975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69042cd-ccc5-4f4d-b623-93712a7a3fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:44.022167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-f69042cd-ccc5-4f4d-b623-93712a7a3fde None None] MFA Rules not processed for user `e352e983ce124083813a9de8561a3616`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:44.023436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f69042cd-ccc5-4f4d-b623-93712a7a3fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:44.095272 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1270/2517] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:44.108883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de8a2-61a3-49e1-96cd-b97c7ac1b53c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:44.167041 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de8a2-61a3-49e1-96cd-b97c7ac1b53c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:44.171900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbca91-ca5f-48d9-bed6-4051cb57a603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:44.172549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbca91-ca5f-48d9-bed6-4051cb57a603 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:44.172834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbca91-ca5f-48d9-bed6-4051cb57a603 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:44.173116 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbca91-ca5f-48d9-bed6-4051cb57a603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:44.182347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbca91-ca5f-48d9-bed6-4051cb57a603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:44.184329 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbca91-ca5f-48d9-bed6-4051cb57a603 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:44.194334 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1248/2518] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:44.267795 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69042cd-ccc5-4f4d-b623-93712a7a3fde None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:44.279281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69042cd-ccc5-4f4d-b623-93712a7a3fde None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:44.283113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d80ea-9677-41c0-a48a-570884ab2109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:44.283764 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d80ea-9677-41c0-a48a-570884ab2109 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:44.284048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d80ea-9677-41c0-a48a-570884ab2109 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:44.284329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d80ea-9677-41c0-a48a-570884ab2109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:44.288747 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:44.347804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d80ea-9677-41c0-a48a-570884ab2109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:44.349362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d80ea-9677-41c0-a48a-570884ab2109 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:44.360625 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1271/2519] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:46.064495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbca91-ca5f-48d9-bed6-4051cb57a603 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:46.065912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7fdbca91-ca5f-48d9-bed6-4051cb57a603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:46.137615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbca91-ca5f-48d9-bed6-4051cb57a603 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:46.142309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:46.143248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:46.143530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:46.143810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] PATH_INFO: `/v3/users/e9acb3177d2f488988001d25393e5977` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:46.145104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9acb3177d2f488988001d25393e5977)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:46.147104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:46.201532 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9acb3177d2f488988001d25393e5977'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.202219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9acb3177d2f488988001d25393e5977'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.213895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:46.215303 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9acb3177d2f488988001d25393e5977'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.224939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9acb3177d2f488988001d25393e5977'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.232494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9acb3177d2f488988001d25393e5977'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.238988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1249/2520] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:46 2022] DELETE /identity/v3/users/e9acb3177d2f488988001d25393e5977 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:46.245396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ae47-08e0-4c8c-8822-db19d0944ef1 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:46.246701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ae47-08e0-4c8c-8822-db19d0944ef1 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:46.247038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ae47-08e0-4c8c-8822-db19d0944ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:46.264770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-08c8ae47-08e0-4c8c-8822-db19d0944ef1 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:46.265975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-08c8ae47-08e0-4c8c-8822-db19d0944ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:46.327224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1272/2521] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:46.337293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:46.338767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:46.397459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c2bc9-a67f-4bac-a40f-bf69a19147a3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:46.401160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecf28e-8d29-497e-860a-e42954ab1416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:46.401861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecf28e-8d29-497e-860a-e42954ab1416 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:46.402151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecf28e-8d29-497e-860a-e42954ab1416 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:46.402864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecf28e-8d29-497e-860a-e42954ab1416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:46.412062 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecf28e-8d29-497e-860a-e42954ab1416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:46.413504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ecf28e-8d29-497e-860a-e42954ab1416 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:46.423596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1250/2522] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:46.706901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8ae47-08e0-4c8c-8822-db19d0944ef1 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:46.708448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-08c8ae47-08e0-4c8c-8822-db19d0944ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:46.721870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8ae47-08e0-4c8c-8822-db19d0944ef1 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:46.728368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:46.729718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:46.729718 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:46.730884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] PATH_INFO: `/v3/projects/5f8984c20dfc496982cfda8a54b0db9c` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:46.734111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8984c20dfc496982cfda8a54b0db9c)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:46.736167 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:46.795982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8984c20dfc496982cfda8a54b0db9c', 'request_id': 'req-751af8f7-199a-4466-8bee-38984d00dc09'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.803529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8984c20dfc496982cfda8a54b0db9c', 'request_id': 'req-751af8f7-199a-4466-8bee-38984d00dc09'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.810700 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8984c20dfc496982cfda8a54b0db9c', 'request_id': 'req-751af8f7-199a-4466-8bee-38984d00dc09'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.821192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] The token cache is being invalidate because project 5f8984c20dfc496982cfda8a54b0db9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:46.821485 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.822139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.823827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1273/2523] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:46 2022] DELETE /identity/v3/projects/5f8984c20dfc496982cfda8a54b0db9c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:46.827914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecf28e-8d29-497e-860a-e42954ab1416 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:46.838030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ecf28e-8d29-497e-860a-e42954ab1416 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:46.896751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:46.897622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:46.897911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:46.898193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] PATH_INFO: `/v3/users/662842e704c548879c78b40a06b785d9` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:46.899429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=662842e704c548879c78b40a06b785d9)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:46.901377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:46.962936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662842e704c548879c78b40a06b785d9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.963691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662842e704c548879c78b40a06b785d9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.978771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662842e704c548879c78b40a06b785d9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.987480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662842e704c548879c78b40a06b785d9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:46.996552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-818d07de-6b6e-439d-ab27-63209aba6ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662842e704c548879c78b40a06b785d9'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:47.003110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1251/2524] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:46 2022] DELETE /identity/v3/users/662842e704c548879c78b40a06b785d9 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:47.301061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:47.302654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:47.329875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751af8f7-199a-4466-8bee-38984d00dc09 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:47.363632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:47.396406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:47.397271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.397556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.397843 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] PATH_INFO: `/v3/projects/b95565e3cdf0486d9fd9b97a72f8f80e` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.399061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95565e3cdf0486d9fd9b97a72f8f80e)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:47.400988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:47.461443 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95565e3cdf0486d9fd9b97a72f8f80e', 'request_id': 'req-fcbbd573-dde9-484b-bcb4-958b168f920f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:47.468937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95565e3cdf0486d9fd9b97a72f8f80e', 'request_id': 'req-fcbbd573-dde9-484b-bcb4-958b168f920f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:47.475321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95565e3cdf0486d9fd9b97a72f8f80e', 'request_id': 'req-fcbbd573-dde9-484b-bcb4-958b168f920f'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:47.486232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] The token cache is being invalidate because project b95565e3cdf0486d9fd9b97a72f8f80e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:47.486531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:47.487195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-fcbbd573-dde9-484b-bcb4-958b168f920f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:47.488779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1274/2525] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:47 2022] DELETE /identity/v3/projects/b95565e3cdf0486d9fd9b97a72f8f80e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:47.493706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fc00a-0f5c-4665-917c-691eb69ea5b9 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.494179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fc00a-0f5c-4665-917c-691eb69ea5b9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.494295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fc00a-0f5c-4665-917c-691eb69ea5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.501285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:47.515883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-688fc00a-0f5c-4665-917c-691eb69ea5b9 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:47.517119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-688fc00a-0f5c-4665-917c-691eb69ea5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:47.579601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1252/2526] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:47.587384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0966b-0f60-490b-b11b-fc5234bb8508 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.587621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0966b-0f60-490b-b11b-fc5234bb8508 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.587911 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0966b-0f60-490b-b11b-fc5234bb8508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.607446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-e2d0966b-0f60-490b-b11b-fc5234bb8508 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:47.608680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e2d0966b-0f60-490b-b11b-fc5234bb8508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:47.617035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1275/2527] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:47.621917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fc00a-0f5c-4665-917c-691eb69ea5b9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:47.631926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fc00a-0f5c-4665-917c-691eb69ea5b9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:47.636522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96a658-9fc0-4b9b-abc8-1ce06e939ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:47.637345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96a658-9fc0-4b9b-abc8-1ce06e939ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.637654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96a658-9fc0-4b9b-abc8-1ce06e939ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.637910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96a658-9fc0-4b9b-abc8-1ce06e939ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.638668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96a658-9fc0-4b9b-abc8-1ce06e939ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:00:47.638975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96a658-9fc0-4b9b-abc8-1ce06e939ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:47.640585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96a658-9fc0-4b9b-abc8-1ce06e939ba5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:47.653187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1253/2528] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:00:47.658565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0966b-0f60-490b-b11b-fc5234bb8508 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:47.669269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0966b-0f60-490b-b11b-fc5234bb8508 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:47.673963 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103c41-3180-474e-91db-1d49b4b0841a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:47.674657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103c41-3180-474e-91db-1d49b4b0841a admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.674940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103c41-3180-474e-91db-1d49b4b0841a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.675245 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103c41-3180-474e-91db-1d49b4b0841a admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.675934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103c41-3180-474e-91db-1d49b4b0841a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:47.677844 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103c41-3180-474e-91db-1d49b4b0841a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:47.704331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1276/2529] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:47 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:47.708613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96a658-9fc0-4b9b-abc8-1ce06e939ba5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:47.719646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96a658-9fc0-4b9b-abc8-1ce06e939ba5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:47.776535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61ecb9-e335-4bac-9e60-b081d3865cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:47.777772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ecb9-e335-4bac-9e60-b081d3865cee admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.778089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ecb9-e335-4bac-9e60-b081d3865cee admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.778400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61ecb9-e335-4bac-9e60-b081d3865cee admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.779113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61ecb9-e335-4bac-9e60-b081d3865cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:47.781076 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e61ecb9-e335-4bac-9e60-b081d3865cee admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:47.805484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1254/2530] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:47 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:47.806711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103c41-3180-474e-91db-1d49b4b0841a admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:47.818079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103c41-3180-474e-91db-1d49b4b0841a admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:47.823798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070be1d-2a66-4df2-92e1-d60ffe8dd2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:47.824519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070be1d-2a66-4df2-92e1-d60ffe8dd2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.824763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070be1d-2a66-4df2-92e1-d60ffe8dd2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.825039 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070be1d-2a66-4df2-92e1-d60ffe8dd2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.825765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070be1d-2a66-4df2-92e1-d60ffe8dd2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:47.827414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070be1d-2a66-4df2-92e1-d60ffe8dd2c4 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:47.840602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1277/2531] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:47.844731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61ecb9-e335-4bac-9e60-b081d3865cee admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:47.855784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61ecb9-e335-4bac-9e60-b081d3865cee admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:47.860447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73d0b8-faf3-47dc-bb2a-786107efd5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:47.861118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73d0b8-faf3-47dc-bb2a-786107efd5ea admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.861401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73d0b8-faf3-47dc-bb2a-786107efd5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.861681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73d0b8-faf3-47dc-bb2a-786107efd5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.862443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73d0b8-faf3-47dc-bb2a-786107efd5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:47.864051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73d0b8-faf3-47dc-bb2a-786107efd5ea admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:47.874330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1255/2532] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:00:47.878704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070be1d-2a66-4df2-92e1-d60ffe8dd2c4 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:47.889140 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070be1d-2a66-4df2-92e1-d60ffe8dd2c4 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:47.894334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77b3e7-75c0-4c49-a057-3c67b2d23685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:47.895290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77b3e7-75c0-4c49-a057-3c67b2d23685 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.895575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77b3e7-75c0-4c49-a057-3c67b2d23685 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.895854 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77b3e7-75c0-4c49-a057-3c67b2d23685 admin admin] PATH_INFO: `/v3/projects/8cc422c042274a66a5f7d34b69806123/users/dc01ff32eca1465aab74c6dc2d1d81a7/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.912006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77b3e7-75c0-4c49-a057-3c67b2d23685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cc422c042274a66a5f7d34b69806123, user_id=dc01ff32eca1465aab74c6dc2d1d81a7, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:47.914736 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf77b3e7-75c0-4c49-a057-3c67b2d23685 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:47.928042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1278/2533] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:47 2022] PUT /identity/v3/projects/8cc422c042274a66a5f7d34b69806123/users/dc01ff32eca1465aab74c6dc2d1d81a7/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:47.938599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efc26d-cf01-4809-a1ff-991486900a35 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:47.938904 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efc26d-cf01-4809-a1ff-991486900a35 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:47.939212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efc26d-cf01-4809-a1ff-991486900a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:47.971442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-31efc26d-cf01-4809-a1ff-991486900a35 None None] MFA Rules not processed for user `dc01ff32eca1465aab74c6dc2d1d81a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:47.972648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-31efc26d-cf01-4809-a1ff-991486900a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:48.029618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:48.035874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1256/2534] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:48.040303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77b3e7-75c0-4c49-a057-3c67b2d23685 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:48.098084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:48.103919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77b3e7-75c0-4c49-a057-3c67b2d23685 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:48.110303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad272a9-ec76-4c06-9b91-bbd760f07956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:48.110993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad272a9-ec76-4c06-9b91-bbd760f07956 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:48.111275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad272a9-ec76-4c06-9b91-bbd760f07956 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:48.111551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad272a9-ec76-4c06-9b91-bbd760f07956 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:48.112281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad272a9-ec76-4c06-9b91-bbd760f07956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:48.114232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad272a9-ec76-4c06-9b91-bbd760f07956 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:48.141964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1279/2535] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:48 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:00:48.146161 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efc26d-cf01-4809-a1ff-991486900a35 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:48.157867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efc26d-cf01-4809-a1ff-991486900a35 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:48.216990 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30080ced-3bb7-4a93-bfaf-be3e8e8322c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:48.217659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080ced-3bb7-4a93-bfaf-be3e8e8322c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:48.217938 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080ced-3bb7-4a93-bfaf-be3e8e8322c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:48.218212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30080ced-3bb7-4a93-bfaf-be3e8e8322c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:48.218930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30080ced-3bb7-4a93-bfaf-be3e8e8322c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:48.220855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30080ced-3bb7-4a93-bfaf-be3e8e8322c6 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:48.241939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1257/2536] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:48 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:48.246906 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad272a9-ec76-4c06-9b91-bbd760f07956 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:48.257314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad272a9-ec76-4c06-9b91-bbd760f07956 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:48.262668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ef111-ae42-4c5e-b9f3-47fae0072776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:48.263323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ef111-ae42-4c5e-b9f3-47fae0072776 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:48.263608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ef111-ae42-4c5e-b9f3-47fae0072776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:48.263889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ef111-ae42-4c5e-b9f3-47fae0072776 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:48.264610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ef111-ae42-4c5e-b9f3-47fae0072776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:48.266218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ef111-ae42-4c5e-b9f3-47fae0072776 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:48.276813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1280/2537] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:48.281968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30080ced-3bb7-4a93-bfaf-be3e8e8322c6 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:48.292133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30080ced-3bb7-4a93-bfaf-be3e8e8322c6 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:48.297144 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5f983-c706-45f8-a2a1-64fc9d373cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:48.298030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5f983-c706-45f8-a2a1-64fc9d373cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:48.298343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5f983-c706-45f8-a2a1-64fc9d373cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:48.298629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5f983-c706-45f8-a2a1-64fc9d373cc5 admin admin] PATH_INFO: `/v3/projects/a75a604bc157483da589736b69276c61/users/26262b0249114128a5fcdb72c12b4137/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:48.313874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5f983-c706-45f8-a2a1-64fc9d373cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75a604bc157483da589736b69276c61, user_id=26262b0249114128a5fcdb72c12b4137, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:48.316584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5f983-c706-45f8-a2a1-64fc9d373cc5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:48.330491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1258/2538] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:48 2022] PUT /identity/v3/projects/a75a604bc157483da589736b69276c61/users/26262b0249114128a5fcdb72c12b4137/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:48.334419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ef111-ae42-4c5e-b9f3-47fae0072776 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:48.345916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ef111-ae42-4c5e-b9f3-47fae0072776 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:48.402979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b897bf-881b-4d15-a328-75f4d820f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:48.403607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b897bf-881b-4d15-a328-75f4d820f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:48.403894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b897bf-881b-4d15-a328-75f4d820f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:48.404198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b897bf-881b-4d15-a328-75f4d820f9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:48.404956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b897bf-881b-4d15-a328-75f4d820f9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:48.406593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b897bf-881b-4d15-a328-75f4d820f9e5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:48.416552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1281/2539] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:48.421364 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5f983-c706-45f8-a2a1-64fc9d373cc5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:48.431875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5f983-c706-45f8-a2a1-64fc9d373cc5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:48.437597 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315dfbf-6476-4aa2-9d93-00a5d14612bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:48.438507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315dfbf-6476-4aa2-9d93-00a5d14612bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:48.438793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315dfbf-6476-4aa2-9d93-00a5d14612bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:48.439072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315dfbf-6476-4aa2-9d93-00a5d14612bd admin admin] PATH_INFO: `/v3/projects/a75a604bc157483da589736b69276c61/users/26262b0249114128a5fcdb72c12b4137/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:48.441044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315dfbf-6476-4aa2-9d93-00a5d14612bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75a604bc157483da589736b69276c61, user_id=26262b0249114128a5fcdb72c12b4137, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:48.443739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315dfbf-6476-4aa2-9d93-00a5d14612bd admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:48.455292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1259/2540] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:48 2022] PUT /identity/v3/projects/a75a604bc157483da589736b69276c61/users/26262b0249114128a5fcdb72c12b4137/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:48.466730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d76f5-7c96-489f-b0c1-37347eeb3ef9 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:48.467029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d76f5-7c96-489f-b0c1-37347eeb3ef9 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:48.467346 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d76f5-7c96-489f-b0c1-37347eeb3ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:48.494175 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-318d76f5-7c96-489f-b0c1-37347eeb3ef9 None None] MFA Rules not processed for user `26262b0249114128a5fcdb72c12b4137`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:48.495437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-318d76f5-7c96-489f-b0c1-37347eeb3ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:48.565643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1282/2541] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:48.577390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315dfbf-6476-4aa2-9d93-00a5d14612bd admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:48.579595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3315dfbf-6476-4aa2-9d93-00a5d14612bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:48.640113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315dfbf-6476-4aa2-9d93-00a5d14612bd admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:48.643828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e8c90-eec7-4774-893d-288dce1be9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:48.644472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e8c90-eec7-4774-893d-288dce1be9eb service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:48.644753 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e8c90-eec7-4774-893d-288dce1be9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:48.645030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e8c90-eec7-4774-893d-288dce1be9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:48.655221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e8c90-eec7-4774-893d-288dce1be9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:48.656584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e8c90-eec7-4774-893d-288dce1be9eb service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:48.666221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1260/2542] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:48.711880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d76f5-7c96-489f-b0c1-37347eeb3ef9 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:48.713304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-318d76f5-7c96-489f-b0c1-37347eeb3ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:48.726547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d76f5-7c96-489f-b0c1-37347eeb3ef9 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:48.731617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c28b1-89e1-4708-bad7-3893c097e3f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:48.732277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c28b1-89e1-4708-bad7-3893c097e3f7 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:48.732560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c28b1-89e1-4708-bad7-3893c097e3f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:48.732838 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c28b1-89e1-4708-bad7-3893c097e3f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:48.782205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:48.794735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c28b1-89e1-4708-bad7-3893c097e3f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:48.796217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c28b1-89e1-4708-bad7-3893c097e3f7 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:48.805901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1283/2543] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:00:52.178215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e8c90-eec7-4774-893d-288dce1be9eb service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:52.232512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:52.245915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e8c90-eec7-4774-893d-288dce1be9eb service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:52.251308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:52.252172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:52.252453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:52.252729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] PATH_INFO: `/v3/users/dc01ff32eca1465aab74c6dc2d1d81a7` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:52.253920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc01ff32eca1465aab74c6dc2d1d81a7)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:52.255886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:52.307148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc01ff32eca1465aab74c6dc2d1d81a7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.307812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc01ff32eca1465aab74c6dc2d1d81a7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.320660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc01ff32eca1465aab74c6dc2d1d81a7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.329164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc01ff32eca1465aab74c6dc2d1d81a7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.343614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc01ff32eca1465aab74c6dc2d1d81a7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.354712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1261/2544] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:52 2022] DELETE /identity/v3/users/dc01ff32eca1465aab74c6dc2d1d81a7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:00:52.363498 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963d48-81d9-4a7c-8974-f24f7ba49173 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:52.364255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963d48-81d9-4a7c-8974-f24f7ba49173 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:52.364255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b963d48-81d9-4a7c-8974-f24f7ba49173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:52.383042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2b963d48-81d9-4a7c-8974-f24f7ba49173 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:52.384176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2b963d48-81d9-4a7c-8974-f24f7ba49173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:52.448276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1284/2545] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:52.459018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:52.460641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:52.521819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bf1d2-acfd-4343-8f91-913a7b3eb6fe admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:52.526346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfc575-aa04-4b9e-bee1-ff4e16b76516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:52.528224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfc575-aa04-4b9e-bee1-ff4e16b76516 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:52.528578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfc575-aa04-4b9e-bee1-ff4e16b76516 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:52.528878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfc575-aa04-4b9e-bee1-ff4e16b76516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:52.548351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfc575-aa04-4b9e-bee1-ff4e16b76516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:52.551047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfc575-aa04-4b9e-bee1-ff4e16b76516 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:52.565284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1262/2546] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:52.879594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963d48-81d9-4a7c-8974-f24f7ba49173 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:52.881907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2b963d48-81d9-4a7c-8974-f24f7ba49173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:52.895306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b963d48-81d9-4a7c-8974-f24f7ba49173 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:52.900386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:52.901428 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:52.902161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:52.903343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] PATH_INFO: `/v3/projects/8cc422c042274a66a5f7d34b69806123` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:52.903993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cc422c042274a66a5f7d34b69806123)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:52.905942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:52.961941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cc422c042274a66a5f7d34b69806123', 'request_id': 'req-cf9bd506-51c0-4124-99b3-86ad14f9dceb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.976146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cc422c042274a66a5f7d34b69806123', 'request_id': 'req-cf9bd506-51c0-4124-99b3-86ad14f9dceb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.983984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cc422c042274a66a5f7d34b69806123', 'request_id': 'req-cf9bd506-51c0-4124-99b3-86ad14f9dceb'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.994792 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] The token cache is being invalidate because project 8cc422c042274a66a5f7d34b69806123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:52.994894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.995633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:52.997393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1285/2547] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:52 2022] DELETE /identity/v3/projects/8cc422c042274a66a5f7d34b69806123 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:53.001139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfc575-aa04-4b9e-bee1-ff4e16b76516 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:53.012994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfc575-aa04-4b9e-bee1-ff4e16b76516 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:53.087694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:53.088578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:53.088854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:53.089622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] PATH_INFO: `/v3/users/26262b0249114128a5fcdb72c12b4137` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:53.091194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=26262b0249114128a5fcdb72c12b4137)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:53.093129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:53.110132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:53.146660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26262b0249114128a5fcdb72c12b4137'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.147330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26262b0249114128a5fcdb72c12b4137'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.160616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26262b0249114128a5fcdb72c12b4137'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.169308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26262b0249114128a5fcdb72c12b4137'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.177987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-aca6af5a-42ef-4089-96a0-b238e92ae2bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26262b0249114128a5fcdb72c12b4137'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.184976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1263/2548] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:53 2022] DELETE /identity/v3/users/26262b0249114128a5fcdb72c12b4137 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:53.482852 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:53.485032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:53.501598 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bd506-51c0-4124-99b3-86ad14f9dceb admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:53.564193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:53.565062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:53.565344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:53.565627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] PATH_INFO: `/v3/projects/a75a604bc157483da589736b69276c61` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:53.566855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75a604bc157483da589736b69276c61)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:53.568771 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:53.585148 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:53.616862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75a604bc157483da589736b69276c61', 'request_id': 'req-b751b2db-6433-4405-a21b-695b8c622646'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.626076 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75a604bc157483da589736b69276c61', 'request_id': 'req-b751b2db-6433-4405-a21b-695b8c622646'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.632367 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75a604bc157483da589736b69276c61', 'request_id': 'req-b751b2db-6433-4405-a21b-695b8c622646'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.643222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] The token cache is being invalidate because project a75a604bc157483da589736b69276c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:53.643511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.644159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b751b2db-6433-4405-a21b-695b8c622646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:53.645701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1286/2549] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:53 2022] DELETE /identity/v3/projects/a75a604bc157483da589736b69276c61 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:53.650994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389fbf5-661f-40d1-bbad-39d7e4046851 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:53.651288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389fbf5-661f-40d1-bbad-39d7e4046851 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:53.651570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389fbf5-661f-40d1-bbad-39d7e4046851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:53.669951 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-9389fbf5-661f-40d1-bbad-39d7e4046851 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:53.671252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9389fbf5-661f-40d1-bbad-39d7e4046851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:53.733226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1264/2550] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:53.740734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9a9b-a38f-4fba-8ab4-86638bd3fd8b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:53.741022 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9a9b-a38f-4fba-8ab4-86638bd3fd8b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:53.741303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9a9b-a38f-4fba-8ab4-86638bd3fd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:53.759706 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-117d9a9b-a38f-4fba-8ab4-86638bd3fd8b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:53.760835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-117d9a9b-a38f-4fba-8ab4-86638bd3fd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:53.768876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1287/2551] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:53.773260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389fbf5-661f-40d1-bbad-39d7e4046851 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:53.783911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389fbf5-661f-40d1-bbad-39d7e4046851 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:53.788812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77290ad7-18a9-4fcb-a589-dac5a265f7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:53.789453 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77290ad7-18a9-4fcb-a589-dac5a265f7cc admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:53.789735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77290ad7-18a9-4fcb-a589-dac5a265f7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:53.790007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77290ad7-18a9-4fcb-a589-dac5a265f7cc admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:53.790783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77290ad7-18a9-4fcb-a589-dac5a265f7cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:00:53.791088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77290ad7-18a9-4fcb-a589-dac5a265f7cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:53.793269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77290ad7-18a9-4fcb-a589-dac5a265f7cc admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:53.804998 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1265/2552] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:00:53.809224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d9a9b-a38f-4fba-8ab4-86638bd3fd8b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:53.819023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d9a9b-a38f-4fba-8ab4-86638bd3fd8b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:53.823593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c51c-b570-4911-9e26-b47b65eb03bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:53.824336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c51c-b570-4911-9e26-b47b65eb03bc admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:53.824621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c51c-b570-4911-9e26-b47b65eb03bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:53.824900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c51c-b570-4911-9e26-b47b65eb03bc admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:53.825585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c51c-b570-4911-9e26-b47b65eb03bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:53.827505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c51c-b570-4911-9e26-b47b65eb03bc admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:53.853534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1288/2553] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:53 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:53.858481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77290ad7-18a9-4fcb-a589-dac5a265f7cc admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:53.868795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77290ad7-18a9-4fcb-a589-dac5a265f7cc admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:53.926337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccb9c9-8431-47fa-ac50-634c8d94f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:53.927092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccb9c9-8431-47fa-ac50-634c8d94f3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:53.927398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccb9c9-8431-47fa-ac50-634c8d94f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:53.927678 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccb9c9-8431-47fa-ac50-634c8d94f3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:53.928400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccb9c9-8431-47fa-ac50-634c8d94f3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:53.930367 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccb9c9-8431-47fa-ac50-634c8d94f3f3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:53.951084 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1266/2554] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:53 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:53.955611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c51c-b570-4911-9e26-b47b65eb03bc admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:53.966546 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c51c-b570-4911-9e26-b47b65eb03bc admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:53.971231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c92cb-2ee3-492c-b820-2d1c4d8a1d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:53.971884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c92cb-2ee3-492c-b820-2d1c4d8a1d46 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:53.972171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c92cb-2ee3-492c-b820-2d1c4d8a1d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:53.972452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c92cb-2ee3-492c-b820-2d1c4d8a1d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:53.973180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c92cb-2ee3-492c-b820-2d1c4d8a1d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:53.974828 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c92cb-2ee3-492c-b820-2d1c4d8a1d46 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:53.985934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1289/2555] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:53.990098 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccb9c9-8431-47fa-ac50-634c8d94f3f3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:54.000489 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccb9c9-8431-47fa-ac50-634c8d94f3f3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:54.005224 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4908e-16a3-42d6-86fb-1dc96eb3e8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:54.005881 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4908e-16a3-42d6-86fb-1dc96eb3e8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.006168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4908e-16a3-42d6-86fb-1dc96eb3e8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.006480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4908e-16a3-42d6-86fb-1dc96eb3e8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.007209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4908e-16a3-42d6-86fb-1dc96eb3e8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:54.008844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4908e-16a3-42d6-86fb-1dc96eb3e8f4 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:54.014357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:54.020461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1267/2556] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:54.024383 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c92cb-2ee3-492c-b820-2d1c4d8a1d46 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:54.035323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c92cb-2ee3-492c-b820-2d1c4d8a1d46 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:54.039917 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683b42c-462e-4618-994b-413708fd4965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:54.040791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683b42c-462e-4618-994b-413708fd4965 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.041079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683b42c-462e-4618-994b-413708fd4965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.041360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683b42c-462e-4618-994b-413708fd4965 admin admin] PATH_INFO: `/v3/projects/081c5b47501140c5897ed4edb3674f4e/users/6e2792e0e4b04679b0d21cfe40fbbd82/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.056462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683b42c-462e-4618-994b-413708fd4965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081c5b47501140c5897ed4edb3674f4e, user_id=6e2792e0e4b04679b0d21cfe40fbbd82, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:54.059257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683b42c-462e-4618-994b-413708fd4965 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:54.073199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1290/2557] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:54 2022] PUT /identity/v3/projects/081c5b47501140c5897ed4edb3674f4e/users/6e2792e0e4b04679b0d21cfe40fbbd82/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:54.083920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e6b2-7f25-4272-9ac4-4bc64c62bf0a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.084211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e6b2-7f25-4272-9ac4-4bc64c62bf0a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.084495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e6b2-7f25-4272-9ac4-4bc64c62bf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.111893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-93c3e6b2-7f25-4272-9ac4-4bc64c62bf0a None None] MFA Rules not processed for user `6e2792e0e4b04679b0d21cfe40fbbd82`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:54.113104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-93c3e6b2-7f25-4272-9ac4-4bc64c62bf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:54.208653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1268/2558] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:00:54.213261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683b42c-462e-4618-994b-413708fd4965 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:54.300395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683b42c-462e-4618-994b-413708fd4965 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:54.305560 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3920-4e00-4b52-a9d6-f9998643c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:54.306344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3920-4e00-4b52-a9d6-f9998643c2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.306719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3920-4e00-4b52-a9d6-f9998643c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.307104 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3920-4e00-4b52-a9d6-f9998643c2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.307900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3920-4e00-4b52-a9d6-f9998643c2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:54.310123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3920-4e00-4b52-a9d6-f9998643c2c6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:54.348640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1291/2559] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:00:54 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:54.352740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e6b2-7f25-4272-9ac4-4bc64c62bf0a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:54.365461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e6b2-7f25-4272-9ac4-4bc64c62bf0a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:54.430906 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54fa86-1911-4410-93fc-20c3dd4da004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:54.431580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54fa86-1911-4410-93fc-20c3dd4da004 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.431874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54fa86-1911-4410-93fc-20c3dd4da004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.432176 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54fa86-1911-4410-93fc-20c3dd4da004 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.433557 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54fa86-1911-4410-93fc-20c3dd4da004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:54.435727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54fa86-1911-4410-93fc-20c3dd4da004 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:54.464581 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1269/2560] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:00:54 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:00:54.466093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3920-4e00-4b52-a9d6-f9998643c2c6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:54.483692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3920-4e00-4b52-a9d6-f9998643c2c6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:54.491128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2b611-ad2d-4b8d-9288-669bf4ce1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:54.492264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2b611-ad2d-4b8d-9288-669bf4ce1f81 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.492642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2b611-ad2d-4b8d-9288-669bf4ce1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.493047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2b611-ad2d-4b8d-9288-669bf4ce1f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.493849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2b611-ad2d-4b8d-9288-669bf4ce1f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:54.496787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2b611-ad2d-4b8d-9288-669bf4ce1f81 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:54.519861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1292/2561] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:54.521342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54fa86-1911-4410-93fc-20c3dd4da004 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:54.534276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54fa86-1911-4410-93fc-20c3dd4da004 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:54.543942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35afe5-3335-4221-80c3-82463abc1c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:54.544849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35afe5-3335-4221-80c3-82463abc1c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.545130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35afe5-3335-4221-80c3-82463abc1c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.545493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35afe5-3335-4221-80c3-82463abc1c31 admin admin] PATH_INFO: `/v3/projects/4821fea56afb46699093eb66957e1d11/users/df210292e3eb4b59933c41820f693786/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.563009 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35afe5-3335-4221-80c3-82463abc1c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4821fea56afb46699093eb66957e1d11, user_id=df210292e3eb4b59933c41820f693786, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:54.565739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35afe5-3335-4221-80c3-82463abc1c31 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:54.587831 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1270/2562] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:54 2022] PUT /identity/v3/projects/4821fea56afb46699093eb66957e1d11/users/df210292e3eb4b59933c41820f693786/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:54.594197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2b611-ad2d-4b8d-9288-669bf4ce1f81 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:54.605563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2b611-ad2d-4b8d-9288-669bf4ce1f81 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:54.615380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:54.668208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2facce2-ac6c-413a-9470-df51f6a0fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:54.669368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2facce2-ac6c-413a-9470-df51f6a0fb22 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.669779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2facce2-ac6c-413a-9470-df51f6a0fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.670071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2facce2-ac6c-413a-9470-df51f6a0fb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.670858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2facce2-ac6c-413a-9470-df51f6a0fb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:54.672497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2facce2-ac6c-413a-9470-df51f6a0fb22 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:54.683334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1293/2563] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:00:54.687731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35afe5-3335-4221-80c3-82463abc1c31 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:54.698815 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35afe5-3335-4221-80c3-82463abc1c31 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:54.703846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b073f-ff86-4c5f-ae86-8c849ee7ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:54.704768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b073f-ff86-4c5f-ae86-8c849ee7ab18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.705082 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b073f-ff86-4c5f-ae86-8c849ee7ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.705339 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b073f-ff86-4c5f-ae86-8c849ee7ab18 admin admin] PATH_INFO: `/v3/projects/4821fea56afb46699093eb66957e1d11/users/df210292e3eb4b59933c41820f693786/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.707768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b073f-ff86-4c5f-ae86-8c849ee7ab18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4821fea56afb46699093eb66957e1d11, user_id=df210292e3eb4b59933c41820f693786, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:54.710912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b073f-ff86-4c5f-ae86-8c849ee7ab18 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:54.723478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1271/2564] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:00:54 2022] PUT /identity/v3/projects/4821fea56afb46699093eb66957e1d11/users/df210292e3eb4b59933c41820f693786/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:54.736234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1e184-44e1-4c98-8742-579c2fa3f90d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.736544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1e184-44e1-4c98-8742-579c2fa3f90d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.736825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1e184-44e1-4c98-8742-579c2fa3f90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.768382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-43e1e184-44e1-4c98-8742-579c2fa3f90d None None] MFA Rules not processed for user `df210292e3eb4b59933c41820f693786`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:54.768382 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-43e1e184-44e1-4c98-8742-579c2fa3f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:54.845637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1294/2565] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:54.857150 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b073f-ff86-4c5f-ae86-8c849ee7ab18 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:54.859408 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-1e6b073f-ff86-4c5f-ae86-8c849ee7ab18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:54.911217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:54.924961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b073f-ff86-4c5f-ae86-8c849ee7ab18 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:54.928648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7d465-4e02-465d-abb2-76b6d70140ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:54.929293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7d465-4e02-465d-abb2-76b6d70140ab service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:54.929576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7d465-4e02-465d-abb2-76b6d70140ab service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:54.929854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7d465-4e02-465d-abb2-76b6d70140ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:54.940912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7d465-4e02-465d-abb2-76b6d70140ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:54.942414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7d465-4e02-465d-abb2-76b6d70140ab service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:54.953113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1272/2566] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:55.003478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1e184-44e1-4c98-8742-579c2fa3f90d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:55.004925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-43e1e184-44e1-4c98-8742-579c2fa3f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:55.017904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1e184-44e1-4c98-8742-579c2fa3f90d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:55.021649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3110fc-b602-49be-8198-46e011428021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:55.022302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3110fc-b602-49be-8198-46e011428021 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:55.022628 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3110fc-b602-49be-8198-46e011428021 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:55.022912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3110fc-b602-49be-8198-46e011428021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:55.083535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3110fc-b602-49be-8198-46e011428021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:55.084901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3110fc-b602-49be-8198-46e011428021 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:55.094936 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1295/2567] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:58.580241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7d465-4e02-465d-abb2-76b6d70140ab service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:58.646566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7d465-4e02-465d-abb2-76b6d70140ab service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:58.651015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:58.652512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:58.652791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:58.653060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] PATH_INFO: `/v3/users/6e2792e0e4b04679b0d21cfe40fbbd82` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:58.654265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e2792e0e4b04679b0d21cfe40fbbd82)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:58.656215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:58.701798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e2792e0e4b04679b0d21cfe40fbbd82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:58.702381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e2792e0e4b04679b0d21cfe40fbbd82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:58.715040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e2792e0e4b04679b0d21cfe40fbbd82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:58.725794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e2792e0e4b04679b0d21cfe40fbbd82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:58.734281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e2792e0e4b04679b0d21cfe40fbbd82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:58.740182 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1273/2568] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:58 2022] DELETE /identity/v3/users/6e2792e0e4b04679b0d21cfe40fbbd82 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:58.744694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a590a4-149e-46a6-98a1-8f4c06c0f41d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:58.745207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a590a4-149e-46a6-98a1-8f4c06c0f41d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:58.745411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a590a4-149e-46a6-98a1-8f4c06c0f41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:58.762548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-47a590a4-149e-46a6-98a1-8f4c06c0f41d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:58.763740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-47a590a4-149e-46a6-98a1-8f4c06c0f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:58.792429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:58.822234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1296/2569] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:00:58.833047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:58.834474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:58.899233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffac929-d3a5-4849-8908-b5d323ec5311 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:58.903865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eac486-e88d-4822-aab9-9d49c1175834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:58.904510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eac486-e88d-4822-aab9-9d49c1175834 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:58.904801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eac486-e88d-4822-aab9-9d49c1175834 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:58.905080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eac486-e88d-4822-aab9-9d49c1175834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:58.914385 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eac486-e88d-4822-aab9-9d49c1175834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:58.915828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eac486-e88d-4822-aab9-9d49c1175834 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:58.925839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1274/2570] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:00:59.196940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a590a4-149e-46a6-98a1-8f4c06c0f41d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:59.198469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-47a590a4-149e-46a6-98a1-8f4c06c0f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:59.211269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a590a4-149e-46a6-98a1-8f4c06c0f41d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:59.216907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:59.217766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:59.218045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:59.218335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] PATH_INFO: `/v3/projects/081c5b47501140c5897ed4edb3674f4e` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:59.219552 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=081c5b47501140c5897ed4edb3674f4e)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:59.221473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:59.269916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081c5b47501140c5897ed4edb3674f4e', 'request_id': 'req-6888f345-43ec-41e7-a4a5-67c4bfb062bd'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.277818 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081c5b47501140c5897ed4edb3674f4e', 'request_id': 'req-6888f345-43ec-41e7-a4a5-67c4bfb062bd'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.284143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081c5b47501140c5897ed4edb3674f4e', 'request_id': 'req-6888f345-43ec-41e7-a4a5-67c4bfb062bd'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.295475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] The token cache is being invalidate because project 081c5b47501140c5897ed4edb3674f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:59.295771 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.296416 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.297947 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1297/2571] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:59 2022] DELETE /identity/v3/projects/081c5b47501140c5897ed4edb3674f4e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:59.301910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eac486-e88d-4822-aab9-9d49c1175834 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:59.311859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eac486-e88d-4822-aab9-9d49c1175834 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:59.315545 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:59.371273 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:59.372137 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:59.372419 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:59.372687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] PATH_INFO: `/v3/users/df210292e3eb4b59933c41820f693786` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:59.373890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df210292e3eb4b59933c41820f693786)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:59.375922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:59.424994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df210292e3eb4b59933c41820f693786'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.425632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df210292e3eb4b59933c41820f693786'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.437450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df210292e3eb4b59933c41820f693786'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.444194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df210292e3eb4b59933c41820f693786'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.451994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-9fdd6966-e2d6-4b23-85a7-372c03d9d176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df210292e3eb4b59933c41820f693786'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.458266 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1275/2572] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:00:59 2022] DELETE /identity/v3/users/df210292e3eb4b59933c41820f693786 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:59.744286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:00:59.746655 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:00:59.764397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888f345-43ec-41e7-a4a5-67c4bfb062bd admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:00:59.850908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:00:59.851874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:59.852251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:59.852603 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] PATH_INFO: `/v3/projects/4821fea56afb46699093eb66957e1d11` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:59.853940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4821fea56afb46699093eb66957e1d11)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:00:59.858966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:00:59.919793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4821fea56afb46699093eb66957e1d11', 'request_id': 'req-8aadffe2-2481-48e5-a385-b293f50444cd'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.926938 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4821fea56afb46699093eb66957e1d11', 'request_id': 'req-8aadffe2-2481-48e5-a385-b293f50444cd'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.928853 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:00:59.934748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4821fea56afb46699093eb66957e1d11', 'request_id': 'req-8aadffe2-2481-48e5-a385-b293f50444cd'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.946926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] The token cache is being invalidate because project 4821fea56afb46699093eb66957e1d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:00:59.947213 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.947858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8aadffe2-2481-48e5-a385-b293f50444cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:00:59.949970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1298/2573] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:00:59 2022] DELETE /identity/v3/projects/4821fea56afb46699093eb66957e1d11 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:00:59.955498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274bef0-f721-40d7-83e4-b3b90f2afef8 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:00:59.955961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274bef0-f721-40d7-83e4-b3b90f2afef8 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:00:59.956077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274bef0-f721-40d7-83e4-b3b90f2afef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:00:59.974443 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8274bef0-f721-40d7-83e4-b3b90f2afef8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:00:59.976539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8274bef0-f721-40d7-83e4-b3b90f2afef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:00.046700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1276/2574] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:00.054604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b2e6-3f88-43c2-9a10-a66c0c3939ad None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.054892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b2e6-3f88-43c2-9a10-a66c0c3939ad None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.055168 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10b2e6-3f88-43c2-9a10-a66c0c3939ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.074489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0a10b2e6-3f88-43c2-9a10-a66c0c3939ad None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:00.075717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0a10b2e6-3f88-43c2-9a10-a66c0c3939ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:00.083893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1299/2575] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:00.088160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274bef0-f721-40d7-83e4-b3b90f2afef8 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:00.098428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274bef0-f721-40d7-83e4-b3b90f2afef8 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:00.102640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b5993-77f3-434f-b884-590a0317c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:00.103309 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5993-77f3-434f-b884-590a0317c14e admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.103582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5993-77f3-434f-b884-590a0317c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.103859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5993-77f3-434f-b884-590a0317c14e admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.104619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b5993-77f3-434f-b884-590a0317c14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:01:00.105428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b5993-77f3-434f-b884-590a0317c14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:00.107142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b5993-77f3-434f-b884-590a0317c14e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:00.119448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1277/2576] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:01:00.124472 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10b2e6-3f88-43c2-9a10-a66c0c3939ad None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:00.134207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10b2e6-3f88-43c2-9a10-a66c0c3939ad None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:00.139198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508fd5e-ed94-4fbb-9f19-9d59a9d2c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:00.139857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508fd5e-ed94-4fbb-9f19-9d59a9d2c07f admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.140146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508fd5e-ed94-4fbb-9f19-9d59a9d2c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.140427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508fd5e-ed94-4fbb-9f19-9d59a9d2c07f admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.141133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508fd5e-ed94-4fbb-9f19-9d59a9d2c07f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:00.143141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508fd5e-ed94-4fbb-9f19-9d59a9d2c07f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:00.175772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1300/2577] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:01:00 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:00.180615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b5993-77f3-434f-b884-590a0317c14e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:00.193179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b5993-77f3-434f-b884-590a0317c14e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:00.206500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:00.268805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659df20-4f90-4db4-925b-d862ed9f9316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:00.269662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659df20-4f90-4db4-925b-d862ed9f9316 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.269942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659df20-4f90-4db4-925b-d862ed9f9316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.270217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659df20-4f90-4db4-925b-d862ed9f9316 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.270952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659df20-4f90-4db4-925b-d862ed9f9316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:00.272897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659df20-4f90-4db4-925b-d862ed9f9316 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:00.301410 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1278/2578] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:01:00 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:00.302590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508fd5e-ed94-4fbb-9f19-9d59a9d2c07f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:00.318108 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508fd5e-ed94-4fbb-9f19-9d59a9d2c07f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:00.325660 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18168863-3738-4c32-bae2-c74d4a5486b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:00.326372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18168863-3738-4c32-bae2-c74d4a5486b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.326657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18168863-3738-4c32-bae2-c74d4a5486b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.326996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18168863-3738-4c32-bae2-c74d4a5486b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.327739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18168863-3738-4c32-bae2-c74d4a5486b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:00.329732 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18168863-3738-4c32-bae2-c74d4a5486b3 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:00.350105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1301/2579] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:00.354087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659df20-4f90-4db4-925b-d862ed9f9316 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:00.364984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659df20-4f90-4db4-925b-d862ed9f9316 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:00.369840 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57dc502-3607-4f0a-ab57-14d67e496970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:00.371090 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dc502-3607-4f0a-ab57-14d67e496970 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.371442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dc502-3607-4f0a-ab57-14d67e496970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.371818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dc502-3607-4f0a-ab57-14d67e496970 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.372544 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57dc502-3607-4f0a-ab57-14d67e496970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:00.374172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57dc502-3607-4f0a-ab57-14d67e496970 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:00.384335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1279/2580] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:00.388511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18168863-3738-4c32-bae2-c74d4a5486b3 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:00.398523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18168863-3738-4c32-bae2-c74d4a5486b3 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:00.403231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7152d6-d156-4256-869d-fcbc156306e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:00.404105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7152d6-d156-4256-869d-fcbc156306e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.404396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7152d6-d156-4256-869d-fcbc156306e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.404667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7152d6-d156-4256-869d-fcbc156306e5 admin admin] PATH_INFO: `/v3/projects/b204c05549c242e7bc6df29dcae7b6f1/users/1a2a06f1ca4d458a8bf8ed956f0c4764/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.420056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7152d6-d156-4256-869d-fcbc156306e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b204c05549c242e7bc6df29dcae7b6f1, user_id=1a2a06f1ca4d458a8bf8ed956f0c4764, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:00.422766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7152d6-d156-4256-869d-fcbc156306e5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:00.437470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1302/2581] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:01:00 2022] PUT /identity/v3/projects/b204c05549c242e7bc6df29dcae7b6f1/users/1a2a06f1ca4d458a8bf8ed956f0c4764/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:00.449241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b74bfd-03a9-4dfe-b41b-fb4d86e6d5b6 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.449241 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b74bfd-03a9-4dfe-b41b-fb4d86e6d5b6 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.449627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b74bfd-03a9-4dfe-b41b-fb4d86e6d5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.479801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-e3b74bfd-03a9-4dfe-b41b-fb4d86e6d5b6 None None] MFA Rules not processed for user `1a2a06f1ca4d458a8bf8ed956f0c4764`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:00.481553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e3b74bfd-03a9-4dfe-b41b-fb4d86e6d5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:00.550982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1280/2582] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:00.563526 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7152d6-d156-4256-869d-fcbc156306e5 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:00.565238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3b7152d6-d156-4256-869d-fcbc156306e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:00.629054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7152d6-d156-4256-869d-fcbc156306e5 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:00.632737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ebb70d-0efe-423f-bf97-0dcce9ec27a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:00.633386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb70d-0efe-423f-bf97-0dcce9ec27a3 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.633671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb70d-0efe-423f-bf97-0dcce9ec27a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.633953 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ebb70d-0efe-423f-bf97-0dcce9ec27a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.643227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebb70d-0efe-423f-bf97-0dcce9ec27a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:00.644686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ebb70d-0efe-423f-bf97-0dcce9ec27a3 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:00.654716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1303/2583] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:00.682190 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b74bfd-03a9-4dfe-b41b-fb4d86e6d5b6 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:00.760054 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b74bfd-03a9-4dfe-b41b-fb4d86e6d5b6 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:00.765523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:00.766514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.766799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.767078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] PATH_INFO: `/v3/users/1a2a06f1ca4d458a8bf8ed956f0c4764` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.768306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2a06f1ca4d458a8bf8ed956f0c4764)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:00.770251 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:00.794992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:00.820253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2a06f1ca4d458a8bf8ed956f0c4764'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:00.820907 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2a06f1ca4d458a8bf8ed956f0c4764'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:00.834204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2a06f1ca4d458a8bf8ed956f0c4764'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:00.841769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2a06f1ca4d458a8bf8ed956f0c4764'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:00.850197 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2a06f1ca4d458a8bf8ed956f0c4764'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:00.856281 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1281/2584] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:01:00 2022] DELETE /identity/v3/users/1a2a06f1ca4d458a8bf8ed956f0c4764 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:01:00.860768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d2ae-ca87-41d2-8b7c-75d7a41eb686 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:00.861250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d2ae-ca87-41d2-8b7c-75d7a41eb686 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:00.861338 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989d2ae-ca87-41d2-8b7c-75d7a41eb686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:00.878110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d989d2ae-ca87-41d2-8b7c-75d7a41eb686 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:00.879334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d989d2ae-ca87-41d2-8b7c-75d7a41eb686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:00.943748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1304/2585] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:00.954570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:00.955792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:01.018921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938442b1-e182-47d8-88fa-4da850dffc4d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:01.022603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d817b99-6d04-4c2c-9bcd-afe15c868384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:01.023254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d817b99-6d04-4c2c-9bcd-afe15c868384 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.023540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d817b99-6d04-4c2c-9bcd-afe15c868384 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.023816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d817b99-6d04-4c2c-9bcd-afe15c868384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.034337 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d817b99-6d04-4c2c-9bcd-afe15c868384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:01.035803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d817b99-6d04-4c2c-9bcd-afe15c868384 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:01.046343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1282/2586] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:01.346633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d2ae-ca87-41d2-8b7c-75d7a41eb686 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:01.347996 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d989d2ae-ca87-41d2-8b7c-75d7a41eb686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:01.366915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989d2ae-ca87-41d2-8b7c-75d7a41eb686 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:01.371773 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:01.372634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.372923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.373208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] PATH_INFO: `/v3/projects/b204c05549c242e7bc6df29dcae7b6f1` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.374453 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b204c05549c242e7bc6df29dcae7b6f1)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:01.376410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:01.402128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:01.427803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b204c05549c242e7bc6df29dcae7b6f1', 'request_id': 'req-aee5134a-f221-410d-95af-61e43626e596'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:01.435810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b204c05549c242e7bc6df29dcae7b6f1', 'request_id': 'req-aee5134a-f221-410d-95af-61e43626e596'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:01.442575 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b204c05549c242e7bc6df29dcae7b6f1', 'request_id': 'req-aee5134a-f221-410d-95af-61e43626e596'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:01.454194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] The token cache is being invalidate because project b204c05549c242e7bc6df29dcae7b6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:01:01.454539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:01.455239 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-aee5134a-f221-410d-95af-61e43626e596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:01.456825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1305/2587] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:01:01 2022] DELETE /identity/v3/projects/b204c05549c242e7bc6df29dcae7b6f1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:01.461506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d50768-baa0-4bff-bbaf-04d458e6577c None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.461803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d50768-baa0-4bff-bbaf-04d458e6577c None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.462333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d50768-baa0-4bff-bbaf-04d458e6577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.483936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-33d50768-baa0-4bff-bbaf-04d458e6577c None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:01.486252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-33d50768-baa0-4bff-bbaf-04d458e6577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:01.555301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1283/2588] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:01.563113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015b1e-368c-4125-8f92-1046777e3504 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.563401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015b1e-368c-4125-8f92-1046777e3504 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.563683 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015b1e-368c-4125-8f92-1046777e3504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.584570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-3e015b1e-368c-4125-8f92-1046777e3504 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:01.585768 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3e015b1e-368c-4125-8f92-1046777e3504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:01.594595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1306/2589] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:01.598813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d50768-baa0-4bff-bbaf-04d458e6577c None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:01.609359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d50768-baa0-4bff-bbaf-04d458e6577c None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:01.614260 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a3737-aa4e-44f1-8aaf-402c2f6331a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:01.614936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3737-aa4e-44f1-8aaf-402c2f6331a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.615215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3737-aa4e-44f1-8aaf-402c2f6331a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.615494 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a3737-aa4e-44f1-8aaf-402c2f6331a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.616228 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a3737-aa4e-44f1-8aaf-402c2f6331a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:01:01.616534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a3737-aa4e-44f1-8aaf-402c2f6331a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:01.618126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a3737-aa4e-44f1-8aaf-402c2f6331a0 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:01.630284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1284/2590] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:01:01.634499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015b1e-368c-4125-8f92-1046777e3504 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:01.644847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015b1e-368c-4125-8f92-1046777e3504 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:01.649663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98cce-2218-4109-9a65-a85381ac4e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:01.650343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98cce-2218-4109-9a65-a85381ac4e05 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.650636 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98cce-2218-4109-9a65-a85381ac4e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.650920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff98cce-2218-4109-9a65-a85381ac4e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.652304 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff98cce-2218-4109-9a65-a85381ac4e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:01.654342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff98cce-2218-4109-9a65-a85381ac4e05 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:01.682803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1307/2591] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:01:01 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:01.684735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a3737-aa4e-44f1-8aaf-402c2f6331a0 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:01.695376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a3737-aa4e-44f1-8aaf-402c2f6331a0 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:01.727276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:01.758653 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0022d-e888-47d1-80aa-e72b8e6edc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:01.759320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0022d-e888-47d1-80aa-e72b8e6edc91 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.759602 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0022d-e888-47d1-80aa-e72b8e6edc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.759876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0022d-e888-47d1-80aa-e72b8e6edc91 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.760677 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0022d-e888-47d1-80aa-e72b8e6edc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:01.763338 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0022d-e888-47d1-80aa-e72b8e6edc91 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:01.785916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1285/2592] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:01:01 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:01.790048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98cce-2218-4109-9a65-a85381ac4e05 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:01.801023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff98cce-2218-4109-9a65-a85381ac4e05 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:01.805882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26540de-4804-4ef0-b054-48b2f6877929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:01.806581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26540de-4804-4ef0-b054-48b2f6877929 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.806874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26540de-4804-4ef0-b054-48b2f6877929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.807155 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26540de-4804-4ef0-b054-48b2f6877929 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.808051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26540de-4804-4ef0-b054-48b2f6877929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:01.809765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26540de-4804-4ef0-b054-48b2f6877929 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:01.821351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1308/2593] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:01:01.826060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0022d-e888-47d1-80aa-e72b8e6edc91 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:01.837022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0022d-e888-47d1-80aa-e72b8e6edc91 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:01.842631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826b4de-f872-4402-9542-cfee91c9321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:01.843328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826b4de-f872-4402-9542-cfee91c9321a admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.843622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826b4de-f872-4402-9542-cfee91c9321a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.843900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826b4de-f872-4402-9542-cfee91c9321a admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.844621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826b4de-f872-4402-9542-cfee91c9321a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:01.846357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826b4de-f872-4402-9542-cfee91c9321a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:01.859444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1286/2594] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:01.863568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26540de-4804-4ef0-b054-48b2f6877929 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:01.874093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26540de-4804-4ef0-b054-48b2f6877929 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:01.879235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664635e4-4f52-4164-b76e-40d4cb43168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:01.880297 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664635e4-4f52-4164-b76e-40d4cb43168d admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.880674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664635e4-4f52-4164-b76e-40d4cb43168d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.881076 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664635e4-4f52-4164-b76e-40d4cb43168d admin admin] PATH_INFO: `/v3/projects/2a493f8e913a46c0bbc188ba94b91135/users/a016506e3a104467bc09926acfba95b6/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.897394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664635e4-4f52-4164-b76e-40d4cb43168d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a493f8e913a46c0bbc188ba94b91135, user_id=a016506e3a104467bc09926acfba95b6, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:01.900106 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664635e4-4f52-4164-b76e-40d4cb43168d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:01.920827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1309/2595] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:01:01 2022] PUT /identity/v3/projects/2a493f8e913a46c0bbc188ba94b91135/users/a016506e3a104467bc09926acfba95b6/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:01.926551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bc2d0-ee15-44d6-9419-3279bec9d23b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:01.927014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bc2d0-ee15-44d6-9419-3279bec9d23b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:01.927481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2bc2d0-ee15-44d6-9419-3279bec9d23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:01.949696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8d2bc2d0-ee15-44d6-9419-3279bec9d23b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:01.950941 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8d2bc2d0-ee15-44d6-9419-3279bec9d23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:02.010875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1287/2596] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:01:02.020721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664635e4-4f52-4164-b76e-40d4cb43168d admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:02.022481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-664635e4-4f52-4164-b76e-40d4cb43168d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:02.079807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664635e4-4f52-4164-b76e-40d4cb43168d admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:02.083437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1946-7c57-4706-a483-a0f909f11f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:02.084068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1946-7c57-4706-a483-a0f909f11f73 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:02.084348 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1946-7c57-4706-a483-a0f909f11f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:02.084622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1946-7c57-4706-a483-a0f909f11f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:02.094208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c1946-7c57-4706-a483-a0f909f11f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:02.095668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c1946-7c57-4706-a483-a0f909f11f73 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:02.105613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1310/2597] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:02.826757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd0f6f-8125-4577-8139-c78494ac93fa None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:02.827048 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd0f6f-8125-4577-8139-c78494ac93fa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:02.827324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd0f6f-8125-4577-8139-c78494ac93fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:02.854538 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-20dd0f6f-8125-4577-8139-c78494ac93fa None None] MFA Rules not processed for user `a016506e3a104467bc09926acfba95b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:02.856305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-20dd0f6f-8125-4577-8139-c78494ac93fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:02.926079 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1288/2598] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:02.938093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1946-7c57-4706-a483-a0f909f11f73 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:02.939676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c43c1946-7c57-4706-a483-a0f909f11f73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:02.994962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:03.000333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1946-7c57-4706-a483-a0f909f11f73 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:03.005888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d053f-b26b-4bc4-b91c-507f28dd3496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:03.006735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d053f-b26b-4bc4-b91c-507f28dd3496 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:03.007235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d053f-b26b-4bc4-b91c-507f28dd3496 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:03.007704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d053f-b26b-4bc4-b91c-507f28dd3496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:03.016995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d053f-b26b-4bc4-b91c-507f28dd3496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:03.018471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d053f-b26b-4bc4-b91c-507f28dd3496 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:03.028012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1311/2599] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:04.424087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac3eb8-e3d6-457e-8271-28c0923ad5f9 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:04.424659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac3eb8-e3d6-457e-8271-28c0923ad5f9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:04.424659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac3eb8-e3d6-457e-8271-28c0923ad5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:04.442308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-9aac3eb8-e3d6-457e-8271-28c0923ad5f9 None None] MFA Rules not processed for user `a016506e3a104467bc09926acfba95b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:04.443547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9aac3eb8-e3d6-457e-8271-28c0923ad5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:04.450528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1289/2600] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:06.918484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d053f-b26b-4bc4-b91c-507f28dd3496 service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:06.926969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d053f-b26b-4bc4-b91c-507f28dd3496 service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:06.930586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb88b11-fc60-4eef-904a-a39b794f4c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:06.931221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb88b11-fc60-4eef-904a-a39b794f4c1b service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:06.931505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb88b11-fc60-4eef-904a-a39b794f4c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:06.931785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb88b11-fc60-4eef-904a-a39b794f4c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:06.934354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0cb88b11-fc60-4eef-904a-a39b794f4c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:06.944037 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb88b11-fc60-4eef-904a-a39b794f4c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:06.945458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb88b11-fc60-4eef-904a-a39b794f4c1b service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:06.954878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1312/2601] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:14.437963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:16.950827 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=10 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:32.461213 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac3eb8-e3d6-457e-8271-28c0923ad5f9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:32.462718 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9aac3eb8-e3d6-457e-8271-28c0923ad5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:32.477922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac3eb8-e3d6-457e-8271-28c0923ad5f9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:32.483163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:32.484045 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:32.484400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:32.484632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] PATH_INFO: `/v3/users/d33755a6ac984564ad29a3288c7a8952` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:32.486078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33755a6ac984564ad29a3288c7a8952)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:32.488143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:32.545324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33755a6ac984564ad29a3288c7a8952'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:32.545324 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33755a6ac984564ad29a3288c7a8952'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:32.562454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33755a6ac984564ad29a3288c7a8952'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:32.570765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33755a6ac984564ad29a3288c7a8952'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:32.581052 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33755a6ac984564ad29a3288c7a8952'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:32.588921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1290/2602] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:01:32 2022] DELETE /identity/v3/users/d33755a6ac984564ad29a3288c7a8952 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:32.594065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9e0f1-f44f-4c9a-9fbc-f9da741a61ed None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:32.594688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9e0f1-f44f-4c9a-9fbc-f9da741a61ed None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:32.594688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9e0f1-f44f-4c9a-9fbc-f9da741a61ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:32.614627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-b3f9e0f1-f44f-4c9a-9fbc-f9da741a61ed None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:32.616576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b3f9e0f1-f44f-4c9a-9fbc-f9da741a61ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:32.689190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1313/2603] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:32.701299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:32.703827 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:32.778918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ddde4-ece7-48ca-981c-ac04f6205d3f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:32.782572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8f771-0092-45fc-bba8-463f314c9555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:32.783225 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8f771-0092-45fc-bba8-463f314c9555 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:32.783512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8f771-0092-45fc-bba8-463f314c9555 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:32.783794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8f771-0092-45fc-bba8-463f314c9555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:32.799064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8f771-0092-45fc-bba8-463f314c9555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:32.801843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8f771-0092-45fc-bba8-463f314c9555 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:32.816351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1291/2604] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:33.150228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9e0f1-f44f-4c9a-9fbc-f9da741a61ed None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:33.151757 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b3f9e0f1-f44f-4c9a-9fbc-f9da741a61ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:33.164868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9e0f1-f44f-4c9a-9fbc-f9da741a61ed None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:33.174023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:33.174952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:33.175235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:33.175513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] PATH_INFO: `/v3/projects/2e7a502db42a4bac8d712ce3d60de9bd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:33.176848 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7a502db42a4bac8d712ce3d60de9bd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:33.178850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:33.233641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7a502db42a4bac8d712ce3d60de9bd', 'request_id': 'req-e9672fa3-0a5c-4a7e-8a64-049df2478207'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.241882 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7a502db42a4bac8d712ce3d60de9bd', 'request_id': 'req-e9672fa3-0a5c-4a7e-8a64-049df2478207'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.251426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7a502db42a4bac8d712ce3d60de9bd', 'request_id': 'req-e9672fa3-0a5c-4a7e-8a64-049df2478207'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.263680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] The token cache is being invalidate because project 2e7a502db42a4bac8d712ce3d60de9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:01:33.263977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.264655 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.266587 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1314/2605] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:01:33 2022] DELETE /identity/v3/projects/2e7a502db42a4bac8d712ce3d60de9bd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:33.278635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8f771-0092-45fc-bba8-463f314c9555 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:33.288512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8f771-0092-45fc-bba8-463f314c9555 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:33.355078 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:33.357230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:33.357512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:33.357893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] PATH_INFO: `/v3/users/e352e983ce124083813a9de8561a3616` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:33.359189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e352e983ce124083813a9de8561a3616)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:33.361125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:33.378464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:33.421743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e352e983ce124083813a9de8561a3616'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.422492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e352e983ce124083813a9de8561a3616'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.437011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e352e983ce124083813a9de8561a3616'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.446645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e352e983ce124083813a9de8561a3616'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.457692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a00121dc-a297-4a00-bd1c-50a2e56cda59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e352e983ce124083813a9de8561a3616'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.465783 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1292/2606] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:01:33 2022] DELETE /identity/v3/users/e352e983ce124083813a9de8561a3616 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:33.761171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:33.763463 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:33.776941 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672fa3-0a5c-4a7e-8a64-049df2478207 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:33.842847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:33.843871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:33.844105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:33.844415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] PATH_INFO: `/v3/projects/7c14ab5c24024d6b9a4b36347ef7367c` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:33.845559 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c14ab5c24024d6b9a4b36347ef7367c)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:33.847501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:33.879454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:33.897793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c14ab5c24024d6b9a4b36347ef7367c', 'request_id': 'req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.908369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c14ab5c24024d6b9a4b36347ef7367c', 'request_id': 'req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.915674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c14ab5c24024d6b9a4b36347ef7367c', 'request_id': 'req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.926518 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] The token cache is being invalidate because project 7c14ab5c24024d6b9a4b36347ef7367c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:01:33.926808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.927456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e3b4b42b-b1fa-41f8-a48b-6778c1adb835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:33.928995 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1315/2607] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:01:33 2022] DELETE /identity/v3/projects/7c14ab5c24024d6b9a4b36347ef7367c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:33.934552 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4b26-c08a-4cea-9dbf-123c8fa8200b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:33.934841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4b26-c08a-4cea-9dbf-123c8fa8200b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:33.935118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4b26-c08a-4cea-9dbf-123c8fa8200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:33.956353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-b01f4b26-c08a-4cea-9dbf-123c8fa8200b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:33.957569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b01f4b26-c08a-4cea-9dbf-123c8fa8200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:34.018478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1293/2608] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:34.026307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342683cb-343e-44e9-90da-1d70fe4be468 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.026627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342683cb-343e-44e9-90da-1d70fe4be468 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.026916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342683cb-343e-44e9-90da-1d70fe4be468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.046530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-342683cb-343e-44e9-90da-1d70fe4be468 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:34.047837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-342683cb-343e-44e9-90da-1d70fe4be468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:34.055999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1316/2609] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:34.061114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f4b26-c08a-4cea-9dbf-123c8fa8200b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.075876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f4b26-c08a-4cea-9dbf-123c8fa8200b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.082692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f05a2b-3298-4479-9b72-eac5e4e26821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.083442 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f05a2b-3298-4479-9b72-eac5e4e26821 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.083778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f05a2b-3298-4479-9b72-eac5e4e26821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.084128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f05a2b-3298-4479-9b72-eac5e4e26821 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.084939 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f05a2b-3298-4479-9b72-eac5e4e26821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:01:34.085325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f05a2b-3298-4479-9b72-eac5e4e26821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.087044 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f05a2b-3298-4479-9b72-eac5e4e26821 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.099267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1294/2610] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:01:34.104006 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342683cb-343e-44e9-90da-1d70fe4be468 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.113758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342683cb-343e-44e9-90da-1d70fe4be468 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.118434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656243c4-4494-4ae2-8c95-d62f6fbbe92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.119088 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656243c4-4494-4ae2-8c95-d62f6fbbe92e admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.119374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656243c4-4494-4ae2-8c95-d62f6fbbe92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.119654 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656243c4-4494-4ae2-8c95-d62f6fbbe92e admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.120355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656243c4-4494-4ae2-8c95-d62f6fbbe92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.122837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656243c4-4494-4ae2-8c95-d62f6fbbe92e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.149576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1317/2611] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:01:34 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:34.153846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f05a2b-3298-4479-9b72-eac5e4e26821 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.163810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f05a2b-3298-4479-9b72-eac5e4e26821 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.223894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226103-17e4-4bd3-9e4e-04f0797f6440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.224578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226103-17e4-4bd3-9e4e-04f0797f6440 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.224874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226103-17e4-4bd3-9e4e-04f0797f6440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.225160 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226103-17e4-4bd3-9e4e-04f0797f6440 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.225900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12226103-17e4-4bd3-9e4e-04f0797f6440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.227946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12226103-17e4-4bd3-9e4e-04f0797f6440 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.249529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1295/2612] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:01:34 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:01:34.253703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656243c4-4494-4ae2-8c95-d62f6fbbe92e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.265821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656243c4-4494-4ae2-8c95-d62f6fbbe92e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.271012 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f1a4e-d8bc-433a-87e9-af18f5d39fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.271687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1a4e-d8bc-433a-87e9-af18f5d39fca admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.271970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1a4e-d8bc-433a-87e9-af18f5d39fca admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.272251 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1a4e-d8bc-433a-87e9-af18f5d39fca admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.272982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f1a4e-d8bc-433a-87e9-af18f5d39fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.274623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f1a4e-d8bc-433a-87e9-af18f5d39fca admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.285576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1318/2613] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:34.289720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226103-17e4-4bd3-9e4e-04f0797f6440 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.301736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226103-17e4-4bd3-9e4e-04f0797f6440 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.306903 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055aaa41-4d88-421d-b05d-b49ed42efdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.307574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055aaa41-4d88-421d-b05d-b49ed42efdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.307862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055aaa41-4d88-421d-b05d-b49ed42efdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.308145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055aaa41-4d88-421d-b05d-b49ed42efdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.309510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055aaa41-4d88-421d-b05d-b49ed42efdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.311166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055aaa41-4d88-421d-b05d-b49ed42efdc4 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.316833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:34.327584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1296/2614] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:34.329282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f1a4e-d8bc-433a-87e9-af18f5d39fca admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.339551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f1a4e-d8bc-433a-87e9-af18f5d39fca admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.344269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762da2d-3d14-4139-b541-d5ec13885009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.345147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762da2d-3d14-4139-b541-d5ec13885009 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.345435 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762da2d-3d14-4139-b541-d5ec13885009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.345722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762da2d-3d14-4139-b541-d5ec13885009 admin admin] PATH_INFO: `/v3/projects/5d6678b9f1fb466bba56b2e991f4ca94/users/896f5027453849e1bb73f51ea123a5d1/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.365178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762da2d-3d14-4139-b541-d5ec13885009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6678b9f1fb466bba56b2e991f4ca94, user_id=896f5027453849e1bb73f51ea123a5d1, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.365178 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762da2d-3d14-4139-b541-d5ec13885009 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.381288 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1319/2615] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:01:34 2022] PUT /identity/v3/projects/5d6678b9f1fb466bba56b2e991f4ca94/users/896f5027453849e1bb73f51ea123a5d1/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:34.391433 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961037f-7be2-445b-815a-2c347250cfbf None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.391717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961037f-7be2-445b-815a-2c347250cfbf None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.392024 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961037f-7be2-445b-815a-2c347250cfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.422776 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3961037f-7be2-445b-815a-2c347250cfbf None None] MFA Rules not processed for user `896f5027453849e1bb73f51ea123a5d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:34.423894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3961037f-7be2-445b-815a-2c347250cfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:34.489784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1297/2616] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:34.494470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762da2d-3d14-4139-b541-d5ec13885009 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.561381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762da2d-3d14-4139-b541-d5ec13885009 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.566062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566b4a-8b91-4689-87c4-a3b3b2bd0097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.566743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566b4a-8b91-4689-87c4-a3b3b2bd0097 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.567028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566b4a-8b91-4689-87c4-a3b3b2bd0097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.567303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98566b4a-8b91-4689-87c4-a3b3b2bd0097 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.567994 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98566b4a-8b91-4689-87c4-a3b3b2bd0097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.569916 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98566b4a-8b91-4689-87c4-a3b3b2bd0097 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.596900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1320/2617] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:01:34 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:34.601253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961037f-7be2-445b-815a-2c347250cfbf None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.613537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961037f-7be2-445b-815a-2c347250cfbf None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.674539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cb397-a447-41b3-a90f-521be231a0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.675117 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cb397-a447-41b3-a90f-521be231a0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.675398 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cb397-a447-41b3-a90f-521be231a0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.675672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cb397-a447-41b3-a90f-521be231a0e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.676389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cb397-a447-41b3-a90f-521be231a0e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.678376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cb397-a447-41b3-a90f-521be231a0e9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.698057 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1298/2618] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:01:34 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:34.702517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566b4a-8b91-4689-87c4-a3b3b2bd0097 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.713260 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98566b4a-8b91-4689-87c4-a3b3b2bd0097 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.718685 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd4f9b-66c3-4dce-a604-b6dfb8862076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.719370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd4f9b-66c3-4dce-a604-b6dfb8862076 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.719629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd4f9b-66c3-4dce-a604-b6dfb8862076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.719908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd4f9b-66c3-4dce-a604-b6dfb8862076 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.720627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd4f9b-66c3-4dce-a604-b6dfb8862076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.722223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd4f9b-66c3-4dce-a604-b6dfb8862076 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.735745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1321/2619] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:34.737687 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cb397-a447-41b3-a90f-521be231a0e9 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.748726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cb397-a447-41b3-a90f-521be231a0e9 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.754139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4501c1-f775-4ecc-9b8d-82b1bbdd01b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.755070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4501c1-f775-4ecc-9b8d-82b1bbdd01b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.755351 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4501c1-f775-4ecc-9b8d-82b1bbdd01b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.755633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4501c1-f775-4ecc-9b8d-82b1bbdd01b7 admin admin] PATH_INFO: `/v3/projects/1455a41413024615983ac738370566d4/users/538e73204876401d8fc9df34fe9b1bbd/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.771167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4501c1-f775-4ecc-9b8d-82b1bbdd01b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1455a41413024615983ac738370566d4, user_id=538e73204876401d8fc9df34fe9b1bbd, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.773811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4501c1-f775-4ecc-9b8d-82b1bbdd01b7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.787684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1299/2620] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:01:34 2022] PUT /identity/v3/projects/1455a41413024615983ac738370566d4/users/538e73204876401d8fc9df34fe9b1bbd/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:34.792116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd4f9b-66c3-4dce-a604-b6dfb8862076 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.803748 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd4f9b-66c3-4dce-a604-b6dfb8862076 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.823149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:34.865879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225c226-9b76-4fa7-a327-707995b3b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.866573 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225c226-9b76-4fa7-a327-707995b3b0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.866861 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225c226-9b76-4fa7-a327-707995b3b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.867143 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225c226-9b76-4fa7-a327-707995b3b0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.867876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225c226-9b76-4fa7-a327-707995b3b0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.869478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225c226-9b76-4fa7-a327-707995b3b0e6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.880172 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1322/2621] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:34.884834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4501c1-f775-4ecc-9b8d-82b1bbdd01b7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:34.896163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4501c1-f775-4ecc-9b8d-82b1bbdd01b7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:34.900807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467631a2-dbbd-46f3-8976-2f903a6b417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:34.901705 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467631a2-dbbd-46f3-8976-2f903a6b417b admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.901987 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467631a2-dbbd-46f3-8976-2f903a6b417b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.902810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467631a2-dbbd-46f3-8976-2f903a6b417b admin admin] PATH_INFO: `/v3/projects/1455a41413024615983ac738370566d4/users/538e73204876401d8fc9df34fe9b1bbd/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.904960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467631a2-dbbd-46f3-8976-2f903a6b417b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1455a41413024615983ac738370566d4, user_id=538e73204876401d8fc9df34fe9b1bbd, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:34.907691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467631a2-dbbd-46f3-8976-2f903a6b417b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:34.919019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1300/2622] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:01:34 2022] PUT /identity/v3/projects/1455a41413024615983ac738370566d4/users/538e73204876401d8fc9df34fe9b1bbd/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:01:34.929825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156906c-27f6-46d1-b40d-179dad09f01d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:34.930063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156906c-27f6-46d1-b40d-179dad09f01d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:34.930409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156906c-27f6-46d1-b40d-179dad09f01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:34.959817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8156906c-27f6-46d1-b40d-179dad09f01d None None] MFA Rules not processed for user `538e73204876401d8fc9df34fe9b1bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:34.961039 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8156906c-27f6-46d1-b40d-179dad09f01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:35.029803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1323/2623] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:35.041360 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467631a2-dbbd-46f3-8976-2f903a6b417b admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:35.043656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-467631a2-dbbd-46f3-8976-2f903a6b417b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:35.090340 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:35.105211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467631a2-dbbd-46f3-8976-2f903a6b417b admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:35.109504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53f1fd-9736-49b6-978d-4ee14f857e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:35.110153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53f1fd-9736-49b6-978d-4ee14f857e2f service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:35.110467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53f1fd-9736-49b6-978d-4ee14f857e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:35.110747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53f1fd-9736-49b6-978d-4ee14f857e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:35.120427 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53f1fd-9736-49b6-978d-4ee14f857e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:35.123072 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb53f1fd-9736-49b6-978d-4ee14f857e2f service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:35.133780 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1301/2624] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:35.206311 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156906c-27f6-46d1-b40d-179dad09f01d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:35.216065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156906c-27f6-46d1-b40d-179dad09f01d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:35.220065 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f34cb-f730-4301-a180-d67fecfc9458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:35.220798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f34cb-f730-4301-a180-d67fecfc9458 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:35.221159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f34cb-f730-4301-a180-d67fecfc9458 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:35.221440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f34cb-f730-4301-a180-d67fecfc9458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:35.281567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f34cb-f730-4301-a180-d67fecfc9458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:35.283719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f34cb-f730-4301-a180-d67fecfc9458 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:35.295183 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1324/2625] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:45.128720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=7 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:45.288871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=80 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:49.240629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53f1fd-9736-49b6-978d-4ee14f857e2f service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:49.302218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53f1fd-9736-49b6-978d-4ee14f857e2f service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:49.306768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:49.307617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:49.307895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:49.308170 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] PATH_INFO: `/v3/users/896f5027453849e1bb73f51ea123a5d1` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:49.309345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=896f5027453849e1bb73f51ea123a5d1)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:49.311506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:49.359067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896f5027453849e1bb73f51ea123a5d1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.359721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896f5027453849e1bb73f51ea123a5d1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.371306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896f5027453849e1bb73f51ea123a5d1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.379424 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896f5027453849e1bb73f51ea123a5d1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.387221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896f5027453849e1bb73f51ea123a5d1'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.394235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1302/2626] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:01:49 2022] DELETE /identity/v3/users/896f5027453849e1bb73f51ea123a5d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:49.398769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ccd4a-95ca-49de-a538-500d18760af8 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:49.399328 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ccd4a-95ca-49de-a538-500d18760af8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:49.399430 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ccd4a-95ca-49de-a538-500d18760af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:49.416077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-ca4ccd4a-95ca-49de-a538-500d18760af8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:49.417301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ca4ccd4a-95ca-49de-a538-500d18760af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:49.477781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1325/2627] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:49.488231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:49.489630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:49.546968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae990e9d-3ce8-47e5-be27-07739ccd6bca admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:49.550717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d53d7-76df-4cd2-bb8b-a2f54acdc7d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:49.551365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d53d7-76df-4cd2-bb8b-a2f54acdc7d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:49.551648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d53d7-76df-4cd2-bb8b-a2f54acdc7d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:49.551931 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d53d7-76df-4cd2-bb8b-a2f54acdc7d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:49.561866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d53d7-76df-4cd2-bb8b-a2f54acdc7d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:49.563333 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d53d7-76df-4cd2-bb8b-a2f54acdc7d2 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:49.572912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1303/2628] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:49.839693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ccd4a-95ca-49de-a538-500d18760af8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:49.841281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ca4ccd4a-95ca-49de-a538-500d18760af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:49.857255 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ccd4a-95ca-49de-a538-500d18760af8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:49.863640 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:49.864553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:49.864767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:49.865046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] PATH_INFO: `/v3/projects/5d6678b9f1fb466bba56b2e991f4ca94` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:49.866234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6678b9f1fb466bba56b2e991f4ca94)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:49.868163 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:49.914414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6678b9f1fb466bba56b2e991f4ca94', 'request_id': 'req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.922499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6678b9f1fb466bba56b2e991f4ca94', 'request_id': 'req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.928667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6678b9f1fb466bba56b2e991f4ca94', 'request_id': 'req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.939447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] The token cache is being invalidate because project 5d6678b9f1fb466bba56b2e991f4ca94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:01:49.939733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.940385 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:49.941898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1326/2629] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:01:49 2022] DELETE /identity/v3/projects/5d6678b9f1fb466bba56b2e991f4ca94 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:49.945868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d53d7-76df-4cd2-bb8b-a2f54acdc7d2 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:49.956506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d53d7-76df-4cd2-bb8b-a2f54acdc7d2 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:49.975706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:50.017483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:50.018370 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.018654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.018935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] PATH_INFO: `/v3/users/538e73204876401d8fc9df34fe9b1bbd` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.020119 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538e73204876401d8fc9df34fe9b1bbd)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:50.022171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:50.073752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538e73204876401d8fc9df34fe9b1bbd'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.074444 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538e73204876401d8fc9df34fe9b1bbd'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.086946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538e73204876401d8fc9df34fe9b1bbd'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.093935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538e73204876401d8fc9df34fe9b1bbd'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.101468 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-2b861ad8-7b40-4f52-a548-8346898ecde0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538e73204876401d8fc9df34fe9b1bbd'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.108208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1304/2630] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:01:49 2022] DELETE /identity/v3/users/538e73204876401d8fc9df34fe9b1bbd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:50.381467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:50.382923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:50.398118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5aac88-896c-4cc5-b15f-0be84d3c34ec admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:50.456265 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:50.457047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.457334 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.457617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] PATH_INFO: `/v3/projects/1455a41413024615983ac738370566d4` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.458848 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1455a41413024615983ac738370566d4)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:50.460763 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:50.490877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:50.507715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1455a41413024615983ac738370566d4', 'request_id': 'req-85195afe-3cd5-4565-bf13-6e914387b340'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.515004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1455a41413024615983ac738370566d4', 'request_id': 'req-85195afe-3cd5-4565-bf13-6e914387b340'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.522711 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1455a41413024615983ac738370566d4', 'request_id': 'req-85195afe-3cd5-4565-bf13-6e914387b340'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.534626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] The token cache is being invalidate because project 1455a41413024615983ac738370566d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:01:50.534950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.535609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-85195afe-3cd5-4565-bf13-6e914387b340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:01:50.537150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1327/2631] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:01:50 2022] DELETE /identity/v3/projects/1455a41413024615983ac738370566d4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:50.541950 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb7fb3-feb6-45ae-af92-1bf96fa51bd2 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.542361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb7fb3-feb6-45ae-af92-1bf96fa51bd2 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.542577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb7fb3-feb6-45ae-af92-1bf96fa51bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.561618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7bfb7fb3-feb6-45ae-af92-1bf96fa51bd2 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:50.562858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7bfb7fb3-feb6-45ae-af92-1bf96fa51bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:50.622777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1305/2632] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:50.631026 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f1cdf-0840-42ac-9c32-5e3196c595a7 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.631315 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f1cdf-0840-42ac-9c32-5e3196c595a7 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.631600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f1cdf-0840-42ac-9c32-5e3196c595a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.649482 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-525f1cdf-0840-42ac-9c32-5e3196c595a7 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:50.650715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-525f1cdf-0840-42ac-9c32-5e3196c595a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:50.659077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1328/2633] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:50.663233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb7fb3-feb6-45ae-af92-1bf96fa51bd2 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:50.673800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb7fb3-feb6-45ae-af92-1bf96fa51bd2 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:50.678447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5113e-9ed1-4c7e-a4af-583a60ab6415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:50.679093 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5113e-9ed1-4c7e-a4af-583a60ab6415 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.679376 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5113e-9ed1-4c7e-a4af-583a60ab6415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.679652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5113e-9ed1-4c7e-a4af-583a60ab6415 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.680380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5113e-9ed1-4c7e-a4af-583a60ab6415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:01:50.680681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5113e-9ed1-4c7e-a4af-583a60ab6415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:50.682276 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5113e-9ed1-4c7e-a4af-583a60ab6415 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:50.694081 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1306/2634] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:01:50.698511 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f1cdf-0840-42ac-9c32-5e3196c595a7 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:50.709326 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f1cdf-0840-42ac-9c32-5e3196c595a7 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:50.714086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bc26-1b5b-4df5-96b7-07087638e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:50.714765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bc26-1b5b-4df5-96b7-07087638e097 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.715047 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bc26-1b5b-4df5-96b7-07087638e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.715321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058bc26-1b5b-4df5-96b7-07087638e097 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.716002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058bc26-1b5b-4df5-96b7-07087638e097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:50.718645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058bc26-1b5b-4df5-96b7-07087638e097 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:50.745044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1329/2635] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:01:50 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:01:50.749246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5113e-9ed1-4c7e-a4af-583a60ab6415 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:50.759257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5113e-9ed1-4c7e-a4af-583a60ab6415 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:50.786061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:50.819676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020979cf-c13e-4eae-b0b6-0fbf33fe1c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:50.820346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020979cf-c13e-4eae-b0b6-0fbf33fe1c4b admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.820632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020979cf-c13e-4eae-b0b6-0fbf33fe1c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.820916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020979cf-c13e-4eae-b0b6-0fbf33fe1c4b admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.821619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020979cf-c13e-4eae-b0b6-0fbf33fe1c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:50.823586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020979cf-c13e-4eae-b0b6-0fbf33fe1c4b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:50.845121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1307/2636] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:01:50 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:01:50.849082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bc26-1b5b-4df5-96b7-07087638e097 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:50.860157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058bc26-1b5b-4df5-96b7-07087638e097 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:50.864756 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e32fd4-e2fb-40b8-8f68-ef61fde449a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:50.865409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e32fd4-e2fb-40b8-8f68-ef61fde449a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.865722 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e32fd4-e2fb-40b8-8f68-ef61fde449a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.866001 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e32fd4-e2fb-40b8-8f68-ef61fde449a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.866762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e32fd4-e2fb-40b8-8f68-ef61fde449a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:50.868391 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e32fd4-e2fb-40b8-8f68-ef61fde449a6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:50.883011 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1330/2637] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:50.884200 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020979cf-c13e-4eae-b0b6-0fbf33fe1c4b admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:50.894251 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020979cf-c13e-4eae-b0b6-0fbf33fe1c4b admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:50.898927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6c0eb-f10e-4545-8e96-b770a29c6436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:50.899579 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c0eb-f10e-4545-8e96-b770a29c6436 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.899864 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c0eb-f10e-4545-8e96-b770a29c6436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.900154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6c0eb-f10e-4545-8e96-b770a29c6436 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.900872 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6c0eb-f10e-4545-8e96-b770a29c6436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:50.902501 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6c0eb-f10e-4545-8e96-b770a29c6436 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:50.912349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1308/2638] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:50.916551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e32fd4-e2fb-40b8-8f68-ef61fde449a6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:50.927649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e32fd4-e2fb-40b8-8f68-ef61fde449a6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:50.932716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cc653-3ecd-4e4e-9b97-0d206b228530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:50.933586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cc653-3ecd-4e4e-9b97-0d206b228530 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.933866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cc653-3ecd-4e4e-9b97-0d206b228530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.934142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cc653-3ecd-4e4e-9b97-0d206b228530 admin admin] PATH_INFO: `/v3/projects/310af1c735134b87bc47183e26e4aa91/users/8639309b85fa4b2b8820d3d5cf214189/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:50.949721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cc653-3ecd-4e4e-9b97-0d206b228530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=310af1c735134b87bc47183e26e4aa91, user_id=8639309b85fa4b2b8820d3d5cf214189, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:50.952397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cc653-3ecd-4e4e-9b97-0d206b228530 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:50.965739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1331/2639] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:01:50 2022] PUT /identity/v3/projects/310af1c735134b87bc47183e26e4aa91/users/8639309b85fa4b2b8820d3d5cf214189/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:01:50.976738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a451b9f-1982-481f-9b71-d26ca4a761d9 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:50.977031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a451b9f-1982-481f-9b71-d26ca4a761d9 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:50.977313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a451b9f-1982-481f-9b71-d26ca4a761d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.006652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-6a451b9f-1982-481f-9b71-d26ca4a761d9 None None] MFA Rules not processed for user `8639309b85fa4b2b8820d3d5cf214189`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:51.007859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6a451b9f-1982-481f-9b71-d26ca4a761d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:51.073369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1309/2640] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:51.079117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cc653-3ecd-4e4e-9b97-0d206b228530 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.141295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cc653-3ecd-4e4e-9b97-0d206b228530 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.146032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898eb3-bcd5-4f4a-b314-2fb82fbc75de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.146716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898eb3-bcd5-4f4a-b314-2fb82fbc75de admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.147003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898eb3-bcd5-4f4a-b314-2fb82fbc75de admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.147277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898eb3-bcd5-4f4a-b314-2fb82fbc75de admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.147968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86898eb3-bcd5-4f4a-b314-2fb82fbc75de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.149859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86898eb3-bcd5-4f4a-b314-2fb82fbc75de admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.174632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1332/2641] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:01:51 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:51.178510 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a451b9f-1982-481f-9b71-d26ca4a761d9 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.189900 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a451b9f-1982-481f-9b71-d26ca4a761d9 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.244752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178547d-3902-43d3-965f-5182abc7e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.245343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178547d-3902-43d3-965f-5182abc7e68b admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.245706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178547d-3902-43d3-965f-5182abc7e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.246209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178547d-3902-43d3-965f-5182abc7e68b admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.247086 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178547d-3902-43d3-965f-5182abc7e68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.250253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178547d-3902-43d3-965f-5182abc7e68b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.269657 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1310/2642] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:01:51 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:51.273744 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898eb3-bcd5-4f4a-b314-2fb82fbc75de admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.284874 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898eb3-bcd5-4f4a-b314-2fb82fbc75de admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.289502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991c397-c7d0-49b7-82ae-7ca74f4833a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.290156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991c397-c7d0-49b7-82ae-7ca74f4833a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.290481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991c397-c7d0-49b7-82ae-7ca74f4833a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.290767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991c397-c7d0-49b7-82ae-7ca74f4833a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.291499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991c397-c7d0-49b7-82ae-7ca74f4833a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.293112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991c397-c7d0-49b7-82ae-7ca74f4833a9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.304295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1333/2643] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:51.308210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178547d-3902-43d3-965f-5182abc7e68b admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.318435 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178547d-3902-43d3-965f-5182abc7e68b admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.323058 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24b086-8965-4135-bd62-6c94e2dddcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.323766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b086-8965-4135-bd62-6c94e2dddcaa admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.323992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b086-8965-4135-bd62-6c94e2dddcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.324330 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b086-8965-4135-bd62-6c94e2dddcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.324993 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24b086-8965-4135-bd62-6c94e2dddcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.326682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24b086-8965-4135-bd62-6c94e2dddcaa admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.337121 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1311/2644] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:01:51.341165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991c397-c7d0-49b7-82ae-7ca74f4833a9 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.351864 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991c397-c7d0-49b7-82ae-7ca74f4833a9 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.356595 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b0e83-f503-4cd6-8f49-2c3850b967b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.357520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0e83-f503-4cd6-8f49-2c3850b967b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.358530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0e83-f503-4cd6-8f49-2c3850b967b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.359055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0e83-f503-4cd6-8f49-2c3850b967b0 admin admin] PATH_INFO: `/v3/projects/3143fde7ecf04b23be61e5c112c3d445/users/54e61b8152e043d9b6fcfbd4c9196706/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.374977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b0e83-f503-4cd6-8f49-2c3850b967b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3143fde7ecf04b23be61e5c112c3d445, user_id=54e61b8152e043d9b6fcfbd4c9196706, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.377622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b0e83-f503-4cd6-8f49-2c3850b967b0 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.386464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:51.392154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1334/2645] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:01:51 2022] PUT /identity/v3/projects/3143fde7ecf04b23be61e5c112c3d445/users/54e61b8152e043d9b6fcfbd4c9196706/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:51.402265 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017beb38-42f1-416b-bce9-48d44585bbd3 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.402583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017beb38-42f1-416b-bce9-48d44585bbd3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.402863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017beb38-42f1-416b-bce9-48d44585bbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.431694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-017beb38-42f1-416b-bce9-48d44585bbd3 None None] MFA Rules not processed for user `54e61b8152e043d9b6fcfbd4c9196706`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:51.432916 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-017beb38-42f1-416b-bce9-48d44585bbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:51.437426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:51.501011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1312/2646] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:51.505394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b0e83-f503-4cd6-8f49-2c3850b967b0 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.567471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b0e83-f503-4cd6-8f49-2c3850b967b0 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.572063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec556087-6c28-474c-a121-f584ff9d3a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.572712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec556087-6c28-474c-a121-f584ff9d3a96 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.573003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec556087-6c28-474c-a121-f584ff9d3a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.573275 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec556087-6c28-474c-a121-f584ff9d3a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.573974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec556087-6c28-474c-a121-f584ff9d3a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.575887 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec556087-6c28-474c-a121-f584ff9d3a96 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.600541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1335/2647] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:01:51 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:51.604560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017beb38-42f1-416b-bce9-48d44585bbd3 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.615865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017beb38-42f1-416b-bce9-48d44585bbd3 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.671877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4444a-e2e0-483e-97ae-3a5e19498f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.672539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4444a-e2e0-483e-97ae-3a5e19498f98 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.672821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4444a-e2e0-483e-97ae-3a5e19498f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.673095 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4444a-e2e0-483e-97ae-3a5e19498f98 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.673784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4444a-e2e0-483e-97ae-3a5e19498f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.675728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4444a-e2e0-483e-97ae-3a5e19498f98 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.696847 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1313/2648] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:01:51 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:01:51.700739 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec556087-6c28-474c-a121-f584ff9d3a96 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.711696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec556087-6c28-474c-a121-f584ff9d3a96 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.716289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e2146-f5ab-4a92-b9f5-ddf80fe86829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.717075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e2146-f5ab-4a92-b9f5-ddf80fe86829 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.717075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e2146-f5ab-4a92-b9f5-ddf80fe86829 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.717643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e2146-f5ab-4a92-b9f5-ddf80fe86829 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.718729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e2146-f5ab-4a92-b9f5-ddf80fe86829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.719966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e2146-f5ab-4a92-b9f5-ddf80fe86829 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.730823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1336/2649] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:51.735568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4444a-e2e0-483e-97ae-3a5e19498f98 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.745483 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4444a-e2e0-483e-97ae-3a5e19498f98 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.751162 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832541-41c6-4058-9b92-4867a92eba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.751968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832541-41c6-4058-9b92-4867a92eba3f admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.752244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832541-41c6-4058-9b92-4867a92eba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.752516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832541-41c6-4058-9b92-4867a92eba3f admin admin] PATH_INFO: `/v3/projects/0550dcff01f84fa6b01331bb21415eac/users/73c4fb90d76140e2aa943cf5f059052b/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.767481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d832541-41c6-4058-9b92-4867a92eba3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0550dcff01f84fa6b01331bb21415eac, user_id=73c4fb90d76140e2aa943cf5f059052b, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.770109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d832541-41c6-4058-9b92-4867a92eba3f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.783335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1314/2650] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:01:51 2022] PUT /identity/v3/projects/0550dcff01f84fa6b01331bb21415eac/users/73c4fb90d76140e2aa943cf5f059052b/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:51.787261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e2146-f5ab-4a92-b9f5-ddf80fe86829 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.797988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e2146-f5ab-4a92-b9f5-ddf80fe86829 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.853493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6a5b1-a8ae-4a75-9e20-27b8e9f0a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.854148 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6a5b1-a8ae-4a75-9e20-27b8e9f0a845 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.854460 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6a5b1-a8ae-4a75-9e20-27b8e9f0a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.854740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6a5b1-a8ae-4a75-9e20-27b8e9f0a845 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.855451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6a5b1-a8ae-4a75-9e20-27b8e9f0a845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.857034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6a5b1-a8ae-4a75-9e20-27b8e9f0a845 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.866548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1337/2651] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:01:51.870660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832541-41c6-4058-9b92-4867a92eba3f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:51.881662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832541-41c6-4058-9b92-4867a92eba3f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:51.886297 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caef1c2-6f97-48bb-9269-9d83acd5681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:51.887219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caef1c2-6f97-48bb-9269-9d83acd5681f admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.887486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caef1c2-6f97-48bb-9269-9d83acd5681f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.887766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caef1c2-6f97-48bb-9269-9d83acd5681f admin admin] PATH_INFO: `/v3/projects/0550dcff01f84fa6b01331bb21415eac/users/73c4fb90d76140e2aa943cf5f059052b/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.890535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caef1c2-6f97-48bb-9269-9d83acd5681f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0550dcff01f84fa6b01331bb21415eac, user_id=73c4fb90d76140e2aa943cf5f059052b, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:51.893186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caef1c2-6f97-48bb-9269-9d83acd5681f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:51.904245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1315/2652] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:01:51 2022] PUT /identity/v3/projects/0550dcff01f84fa6b01331bb21415eac/users/73c4fb90d76140e2aa943cf5f059052b/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:01:51.914403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62d30-619b-4d38-8723-9fc59d489fec None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:51.914698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62d30-619b-4d38-8723-9fc59d489fec None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:51.914984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd62d30-619b-4d38-8723-9fc59d489fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:51.942893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2dd62d30-619b-4d38-8723-9fc59d489fec None None] MFA Rules not processed for user `73c4fb90d76140e2aa943cf5f059052b`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:51.944102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2dd62d30-619b-4d38-8723-9fc59d489fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:52.002399 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:52.011930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1338/2653] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:01:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:52.023141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caef1c2-6f97-48bb-9269-9d83acd5681f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:52.024883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4caef1c2-6f97-48bb-9269-9d83acd5681f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:52.082475 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caef1c2-6f97-48bb-9269-9d83acd5681f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:52.086124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b866d-a5a7-49c3-b95a-4167b6bb08a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:52.086796 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b866d-a5a7-49c3-b95a-4167b6bb08a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:52.087080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b866d-a5a7-49c3-b95a-4167b6bb08a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:52.087357 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b866d-a5a7-49c3-b95a-4167b6bb08a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:52.096693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b866d-a5a7-49c3-b95a-4167b6bb08a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:52.098122 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b866d-a5a7-49c3-b95a-4167b6bb08a1 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:52.106735 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:52.113972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1316/2654] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:52.601577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62d30-619b-4d38-8723-9fc59d489fec None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:52.603010 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2dd62d30-619b-4d38-8723-9fc59d489fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:52.615410 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd62d30-619b-4d38-8723-9fc59d489fec None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:52.618999 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b602a8-1437-4056-bebb-30b6f425443f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:52.619624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b602a8-1437-4056-bebb-30b6f425443f service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:52.619905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b602a8-1437-4056-bebb-30b6f425443f service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:52.620179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b602a8-1437-4056-bebb-30b6f425443f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:52.677842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b602a8-1437-4056-bebb-30b6f425443f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:52.679386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b602a8-1437-4056-bebb-30b6f425443f service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:52.688528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1339/2655] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:57.728039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b866d-a5a7-49c3-b95a-4167b6bb08a1 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:57.737703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b866d-a5a7-49c3-b95a-4167b6bb08a1 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:57.741405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6794591-a254-4e68-a554-3f7e94e945ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:57.742039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6794591-a254-4e68-a554-3f7e94e945ed service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:57.742388 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6794591-a254-4e68-a554-3f7e94e945ed service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:57.742635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6794591-a254-4e68-a554-3f7e94e945ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:57.801226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6794591-a254-4e68-a554-3f7e94e945ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:57.802703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6794591-a254-4e68-a554-3f7e94e945ed service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:57.811599 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1317/2656] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:59.671051 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b602a8-1437-4056-bebb-30b6f425443f service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:59.673073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-c6b602a8-1437-4056-bebb-30b6f425443f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:59.787514 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b602a8-1437-4056-bebb-30b6f425443f service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:59.795235 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd5fe5-e18c-4892-8c13-1323873575b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:59.795826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd5fe5-e18c-4892-8c13-1323873575b6 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:59.796170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd5fe5-e18c-4892-8c13-1323873575b6 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:59.796451 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd5fe5-e18c-4892-8c13-1323873575b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:59.799908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e8bd5fe5-e18c-4892-8c13-1323873575b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:59.819357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd5fe5-e18c-4892-8c13-1323873575b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:59.822058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd5fe5-e18c-4892-8c13-1323873575b6 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:59.853156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1340/2657] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:00.017803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6794591-a254-4e68-a554-3f7e94e945ed service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:00.094215 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6794591-a254-4e68-a554-3f7e94e945ed service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:00.100449 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:00.101322 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:00.101601 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:00.101876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] PATH_INFO: `/v3/users/8639309b85fa4b2b8820d3d5cf214189` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:00.103129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8639309b85fa4b2b8820d3d5cf214189)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:00.105096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:00.161685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8639309b85fa4b2b8820d3d5cf214189'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.162752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8639309b85fa4b2b8820d3d5cf214189'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.179304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8639309b85fa4b2b8820d3d5cf214189'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.187136 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8639309b85fa4b2b8820d3d5cf214189'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.197542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8639309b85fa4b2b8820d3d5cf214189'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.205583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1318/2658] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:00 2022] DELETE /identity/v3/users/8639309b85fa4b2b8820d3d5cf214189 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:00.210237 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055b2e8-4ca5-421d-bf97-d24cb9bb35c9 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:00.210663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055b2e8-4ca5-421d-bf97-d24cb9bb35c9 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:00.210952 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055b2e8-4ca5-421d-bf97-d24cb9bb35c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:00.229787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-f055b2e8-4ca5-421d-bf97-d24cb9bb35c9 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:00.231090 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f055b2e8-4ca5-421d-bf97-d24cb9bb35c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:00.333695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1341/2659] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:00.343374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:00.344922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:00.375231 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:00.431126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11b577-e5a6-4955-ac9e-1c0ddda886d5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:00.435690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f5ead-3b5b-4d14-afdf-9478a38434f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:00.436359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f5ead-3b5b-4d14-afdf-9478a38434f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:00.436640 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f5ead-3b5b-4d14-afdf-9478a38434f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:00.436914 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f5ead-3b5b-4d14-afdf-9478a38434f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:00.450433 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f5ead-3b5b-4d14-afdf-9478a38434f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:00.451976 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f5ead-3b5b-4d14-afdf-9478a38434f2 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:00.463882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1319/2660] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:00.775541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055b2e8-4ca5-421d-bf97-d24cb9bb35c9 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:00.777667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f055b2e8-4ca5-421d-bf97-d24cb9bb35c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:00.791115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055b2e8-4ca5-421d-bf97-d24cb9bb35c9 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:00.796149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:00.796899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:00.797180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:00.797458 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] PATH_INFO: `/v3/projects/310af1c735134b87bc47183e26e4aa91` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:00.799501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310af1c735134b87bc47183e26e4aa91)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:00.801442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:00.820939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:00.859402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310af1c735134b87bc47183e26e4aa91', 'request_id': 'req-02a757c3-c209-49f1-8349-c963df312c20'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.867379 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310af1c735134b87bc47183e26e4aa91', 'request_id': 'req-02a757c3-c209-49f1-8349-c963df312c20'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.873980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310af1c735134b87bc47183e26e4aa91', 'request_id': 'req-02a757c3-c209-49f1-8349-c963df312c20'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.886402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] The token cache is being invalidate because project 310af1c735134b87bc47183e26e4aa91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:00.886697 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.887366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:00.888933 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1342/2661] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:00 2022] DELETE /identity/v3/projects/310af1c735134b87bc47183e26e4aa91 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:00.894618 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f5ead-3b5b-4d14-afdf-9478a38434f2 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:00.904744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f5ead-3b5b-4d14-afdf-9478a38434f2 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:00.995825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:00.997042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:00.997459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:00.997943 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] PATH_INFO: `/v3/users/54e61b8152e043d9b6fcfbd4c9196706` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:00.999563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e61b8152e043d9b6fcfbd4c9196706)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:01.001802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:01.069988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e61b8152e043d9b6fcfbd4c9196706'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.070828 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e61b8152e043d9b6fcfbd4c9196706'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.087378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e61b8152e043d9b6fcfbd4c9196706'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.097789 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e61b8152e043d9b6fcfbd4c9196706'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.109738 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e61b8152e043d9b6fcfbd4c9196706'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.120089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1320/2662] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:00 2022] DELETE /identity/v3/users/54e61b8152e043d9b6fcfbd4c9196706 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:01.591520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:01.593084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:01.607604 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a757c3-c209-49f1-8349-c963df312c20 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:01.667705 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:01.668481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:01.668765 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:01.669042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] PATH_INFO: `/v3/projects/3143fde7ecf04b23be61e5c112c3d445` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:01.670238 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3143fde7ecf04b23be61e5c112c3d445)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:01.672198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:01.718286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3143fde7ecf04b23be61e5c112c3d445', 'request_id': 'req-89918d16-2e06-4def-b596-65f573947568'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.727401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3143fde7ecf04b23be61e5c112c3d445', 'request_id': 'req-89918d16-2e06-4def-b596-65f573947568'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.740480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3143fde7ecf04b23be61e5c112c3d445', 'request_id': 'req-89918d16-2e06-4def-b596-65f573947568'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.756094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] The token cache is being invalidate because project 3143fde7ecf04b23be61e5c112c3d445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:01.756400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.757515 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.759425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1343/2663] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:01 2022] DELETE /identity/v3/projects/3143fde7ecf04b23be61e5c112c3d445 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:01.771335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:01.771335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:01.778401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8289141-f0b3-4b1c-96ef-34c0db96274e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:01.823033 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:01.846000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:01.846952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:01.847236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:01.847516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] PATH_INFO: `/v3/users/73c4fb90d76140e2aa943cf5f059052b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:01.848742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c4fb90d76140e2aa943cf5f059052b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:01.850741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:01.903450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c4fb90d76140e2aa943cf5f059052b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.904115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c4fb90d76140e2aa943cf5f059052b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.918039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c4fb90d76140e2aa943cf5f059052b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.925644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c4fb90d76140e2aa943cf5f059052b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.935253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c4fb90d76140e2aa943cf5f059052b'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:01.941977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1321/2664] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:01 2022] DELETE /identity/v3/users/73c4fb90d76140e2aa943cf5f059052b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:02.252527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:02.254223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:02.281307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89918d16-2e06-4def-b596-65f573947568 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:02.336572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:02.338184 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:02.339713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:02.376205 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:02.378048 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.378484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.379003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] PATH_INFO: `/v3/projects/0550dcff01f84fa6b01331bb21415eac` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.380351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0550dcff01f84fa6b01331bb21415eac)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:02.384615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:02.441170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0550dcff01f84fa6b01331bb21415eac', 'request_id': 'req-8ce5a38c-70b0-4637-a847-b6a427861794'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:02.448788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0550dcff01f84fa6b01331bb21415eac', 'request_id': 'req-8ce5a38c-70b0-4637-a847-b6a427861794'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:02.456787 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e86a9-c536-48b8-b3de-c76132fb446f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:02.457035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0550dcff01f84fa6b01331bb21415eac', 'request_id': 'req-8ce5a38c-70b0-4637-a847-b6a427861794'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:02.468267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] The token cache is being invalidate because project 0550dcff01f84fa6b01331bb21415eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:02.468556 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:02.469417 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-8ce5a38c-70b0-4637-a847-b6a427861794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:02.472102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1344/2665] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:02 2022] DELETE /identity/v3/projects/0550dcff01f84fa6b01331bb21415eac => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:02.478610 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b918f-4543-4b00-acb6-77b416860bf9 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.478892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b918f-4543-4b00-acb6-77b416860bf9 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.479170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b918f-4543-4b00-acb6-77b416860bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.498698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-974b918f-4543-4b00-acb6-77b416860bf9 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:02.499891 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-974b918f-4543-4b00-acb6-77b416860bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:02.519365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:02.539838 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec101a-e1b2-4b15-a01c-453e3a9aff65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:02.540502 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec101a-e1b2-4b15-a01c-453e3a9aff65 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.540823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec101a-e1b2-4b15-a01c-453e3a9aff65 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.541156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec101a-e1b2-4b15-a01c-453e3a9aff65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.543977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4bec101a-e1b2-4b15-a01c-453e3a9aff65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:02.559912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec101a-e1b2-4b15-a01c-453e3a9aff65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:02.561659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec101a-e1b2-4b15-a01c-453e3a9aff65 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:02.576113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1322/2666] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:02.581403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1345/2667] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:02:02.590247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf7577-e571-4dc1-9828-10544e1af6aa None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.590645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf7577-e571-4dc1-9828-10544e1af6aa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.590849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf7577-e571-4dc1-9828-10544e1af6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.612806 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8caf7577-e571-4dc1-9828-10544e1af6aa None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:02.613146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8caf7577-e571-4dc1-9828-10544e1af6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:02.625886 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1323/2668] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:02.630343 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b918f-4543-4b00-acb6-77b416860bf9 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:02.641593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b918f-4543-4b00-acb6-77b416860bf9 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:02.647814 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53188e9-49a8-482f-8324-be80354ea7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:02.648499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53188e9-49a8-482f-8324-be80354ea7bf admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.648789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53188e9-49a8-482f-8324-be80354ea7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.649072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53188e9-49a8-482f-8324-be80354ea7bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.649824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53188e9-49a8-482f-8324-be80354ea7bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:02:02.650135 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53188e9-49a8-482f-8324-be80354ea7bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:02.651892 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53188e9-49a8-482f-8324-be80354ea7bf admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:02.667368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1346/2669] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:02:02.671423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf7577-e571-4dc1-9828-10544e1af6aa None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:02.687535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf7577-e571-4dc1-9828-10544e1af6aa None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:02.698512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f487609-78a9-4ac2-a5f0-9281f8faf6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:02.699569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f487609-78a9-4ac2-a5f0-9281f8faf6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.700065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f487609-78a9-4ac2-a5f0-9281f8faf6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.700563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f487609-78a9-4ac2-a5f0-9281f8faf6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.701825 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f487609-78a9-4ac2-a5f0-9281f8faf6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:02.707029 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f487609-78a9-4ac2-a5f0-9281f8faf6b3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:02.740793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1324/2670] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:02:02 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:02:02.745564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53188e9-49a8-482f-8324-be80354ea7bf admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:02.756712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53188e9-49a8-482f-8324-be80354ea7bf admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:02.812737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:02.828028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1da4a-a103-4438-89a3-b086f8032be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:02.830021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1da4a-a103-4438-89a3-b086f8032be7 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.830824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1da4a-a103-4438-89a3-b086f8032be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.830824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1da4a-a103-4438-89a3-b086f8032be7 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.831600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1da4a-a103-4438-89a3-b086f8032be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:02.833645 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1da4a-a103-4438-89a3-b086f8032be7 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:02.856459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1347/2671] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:02:02 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:02.861251 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f487609-78a9-4ac2-a5f0-9281f8faf6b3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:02.871855 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f487609-78a9-4ac2-a5f0-9281f8faf6b3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:02.877523 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0af0-75dc-493d-81bf-0e1ab18b1d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:02.878148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0af0-75dc-493d-81bf-0e1ab18b1d51 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.878464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0af0-75dc-493d-81bf-0e1ab18b1d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.878748 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0af0-75dc-493d-81bf-0e1ab18b1d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.879478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c0af0-75dc-493d-81bf-0e1ab18b1d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:02.881099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c0af0-75dc-493d-81bf-0e1ab18b1d51 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:02.891730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1325/2672] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:02.896024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1da4a-a103-4438-89a3-b086f8032be7 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:02.906230 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1da4a-a103-4438-89a3-b086f8032be7 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:02.911280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de4ed6-7a4b-4607-b03a-cb2c2c6cd4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:02.911956 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de4ed6-7a4b-4607-b03a-cb2c2c6cd4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.912243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de4ed6-7a4b-4607-b03a-cb2c2c6cd4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.912576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de4ed6-7a4b-4607-b03a-cb2c2c6cd4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.913333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de4ed6-7a4b-4607-b03a-cb2c2c6cd4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:02.914975 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de4ed6-7a4b-4607-b03a-cb2c2c6cd4c1 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:02.932729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1348/2673] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:02.936978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0af0-75dc-493d-81bf-0e1ab18b1d51 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:02.948127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0af0-75dc-493d-81bf-0e1ab18b1d51 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:02.953416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bdb11-77d7-42b6-af9c-b940ebd94fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:02.954587 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bdb11-77d7-42b6-af9c-b940ebd94fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.954846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bdb11-77d7-42b6-af9c-b940ebd94fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.955556 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bdb11-77d7-42b6-af9c-b940ebd94fc4 admin admin] PATH_INFO: `/v3/projects/086114f132af44a1962cc49de410fb1d/users/e132a0e22f85487d8e62faebeed067b1/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.971148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bdb11-77d7-42b6-af9c-b940ebd94fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086114f132af44a1962cc49de410fb1d, user_id=e132a0e22f85487d8e62faebeed067b1, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:02.973918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bdb11-77d7-42b6-af9c-b940ebd94fc4 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:02.988439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1326/2674] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:02 2022] PUT /identity/v3/projects/086114f132af44a1962cc49de410fb1d/users/e132a0e22f85487d8e62faebeed067b1/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:02.999846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd9812-8750-4b1b-a014-44cc15ff694a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.000138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd9812-8750-4b1b-a014-44cc15ff694a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.000442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd9812-8750-4b1b-a014-44cc15ff694a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.028984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-50dd9812-8750-4b1b-a014-44cc15ff694a None None] MFA Rules not processed for user `e132a0e22f85487d8e62faebeed067b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:03.030203 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-50dd9812-8750-4b1b-a014-44cc15ff694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:03.101833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1349/2675] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:03.106445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bdb11-77d7-42b6-af9c-b940ebd94fc4 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.171792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bdb11-77d7-42b6-af9c-b940ebd94fc4 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.177405 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad5f2e-213a-4320-9163-4ab5cf9b4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.178067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad5f2e-213a-4320-9163-4ab5cf9b4c7e admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.178426 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad5f2e-213a-4320-9163-4ab5cf9b4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.178706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad5f2e-213a-4320-9163-4ab5cf9b4c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.179415 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad5f2e-213a-4320-9163-4ab5cf9b4c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.181343 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad5f2e-213a-4320-9163-4ab5cf9b4c7e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:03.207512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1327/2676] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:02:03 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:02:03.211462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd9812-8750-4b1b-a014-44cc15ff694a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.223381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd9812-8750-4b1b-a014-44cc15ff694a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.282054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c990-19c2-4949-a79b-addf4c2c1112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.282811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c990-19c2-4949-a79b-addf4c2c1112 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.283157 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c990-19c2-4949-a79b-addf4c2c1112 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.283465 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45c990-19c2-4949-a79b-addf4c2c1112 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.284184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45c990-19c2-4949-a79b-addf4c2c1112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.286118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45c990-19c2-4949-a79b-addf4c2c1112 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:03.306812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1350/2677] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:02:03 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:03.310977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad5f2e-213a-4320-9163-4ab5cf9b4c7e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.322423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad5f2e-213a-4320-9163-4ab5cf9b4c7e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.327130 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf920ad-80c1-4409-8de5-a7e976e67600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.327800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf920ad-80c1-4409-8de5-a7e976e67600 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.328083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf920ad-80c1-4409-8de5-a7e976e67600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.328362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf920ad-80c1-4409-8de5-a7e976e67600 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.329356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf920ad-80c1-4409-8de5-a7e976e67600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.332131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf920ad-80c1-4409-8de5-a7e976e67600 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:03.343345 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1328/2678] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:03.347926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c990-19c2-4949-a79b-addf4c2c1112 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.358153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45c990-19c2-4949-a79b-addf4c2c1112 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.363466 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2adfbd-5c5e-423b-b0e0-cf9c437385c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.364364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2adfbd-5c5e-423b-b0e0-cf9c437385c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.364652 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2adfbd-5c5e-423b-b0e0-cf9c437385c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.364934 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2adfbd-5c5e-423b-b0e0-cf9c437385c4 admin admin] PATH_INFO: `/v3/projects/3b8ac805eada4191b3aab8df655eadc5/users/ff9255b634fc4ba4bccae8aab5be1fa5/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.381282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2adfbd-5c5e-423b-b0e0-cf9c437385c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8ac805eada4191b3aab8df655eadc5, user_id=ff9255b634fc4ba4bccae8aab5be1fa5, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.383979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2adfbd-5c5e-423b-b0e0-cf9c437385c4 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:03.398833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1351/2679] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:03 2022] PUT /identity/v3/projects/3b8ac805eada4191b3aab8df655eadc5/users/ff9255b634fc4ba4bccae8aab5be1fa5/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:03.403575 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf920ad-80c1-4409-8de5-a7e976e67600 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.413921 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf920ad-80c1-4409-8de5-a7e976e67600 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.471183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:03.481569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b931d-a6ba-480a-b9bb-6ac0f6e007f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.482193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b931d-a6ba-480a-b9bb-6ac0f6e007f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.482562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b931d-a6ba-480a-b9bb-6ac0f6e007f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.482844 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b931d-a6ba-480a-b9bb-6ac0f6e007f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.483586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b931d-a6ba-480a-b9bb-6ac0f6e007f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.485307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b931d-a6ba-480a-b9bb-6ac0f6e007f9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:03.496874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1329/2680] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:03.501113 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2adfbd-5c5e-423b-b0e0-cf9c437385c4 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.521710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2adfbd-5c5e-423b-b0e0-cf9c437385c4 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.528798 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2efa15-8f68-4603-9a7d-36e73ae0dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.530868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2efa15-8f68-4603-9a7d-36e73ae0dd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.531321 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2efa15-8f68-4603-9a7d-36e73ae0dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.532486 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2efa15-8f68-4603-9a7d-36e73ae0dd47 admin admin] PATH_INFO: `/v3/projects/3b8ac805eada4191b3aab8df655eadc5/users/ff9255b634fc4ba4bccae8aab5be1fa5/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.535171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2efa15-8f68-4603-9a7d-36e73ae0dd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8ac805eada4191b3aab8df655eadc5, user_id=ff9255b634fc4ba4bccae8aab5be1fa5, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.538032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2efa15-8f68-4603-9a7d-36e73ae0dd47 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:03.558302 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1352/2681] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:03 2022] PUT /identity/v3/projects/3b8ac805eada4191b3aab8df655eadc5/users/ff9255b634fc4ba4bccae8aab5be1fa5/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:02:03.572325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704287-2858-4891-b96f-87a63cd9317a None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.573049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704287-2858-4891-b96f-87a63cd9317a None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.573580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff704287-2858-4891-b96f-87a63cd9317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.614797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-ff704287-2858-4891-b96f-87a63cd9317a None None] MFA Rules not processed for user `ff9255b634fc4ba4bccae8aab5be1fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:03.616395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ff704287-2858-4891-b96f-87a63cd9317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:03.700818 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1330/2682] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:03.713631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2efa15-8f68-4603-9a7d-36e73ae0dd47 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.715415 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2e2efa15-8f68-4603-9a7d-36e73ae0dd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:03.734716 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:03.785484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2efa15-8f68-4603-9a7d-36e73ae0dd47 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.789308 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f82d8-9504-4bb4-8712-d53040cd47cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.789982 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f82d8-9504-4bb4-8712-d53040cd47cf service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.790267 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f82d8-9504-4bb4-8712-d53040cd47cf service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.790809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f82d8-9504-4bb4-8712-d53040cd47cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.801471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f82d8-9504-4bb4-8712-d53040cd47cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.802966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f82d8-9504-4bb4-8712-d53040cd47cf service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:03.813436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1353/2683] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:03.902204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704287-2858-4891-b96f-87a63cd9317a None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.903733 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ff704287-2858-4891-b96f-87a63cd9317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:03.917232 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff704287-2858-4891-b96f-87a63cd9317a None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.920953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15640244-69fa-4dba-abd2-0e59c2d66996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.921595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640244-69fa-4dba-abd2-0e59c2d66996 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.921882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640244-69fa-4dba-abd2-0e59c2d66996 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.922165 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15640244-69fa-4dba-abd2-0e59c2d66996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.998434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15640244-69fa-4dba-abd2-0e59c2d66996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.999902 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15640244-69fa-4dba-abd2-0e59c2d66996 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:04.011132 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1331/2684] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:12.013050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f82d8-9504-4bb4-8712-d53040cd47cf service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:12.077137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f82d8-9504-4bb4-8712-d53040cd47cf service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:12.082471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:12.083342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:12.083629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:12.083906 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] PATH_INFO: `/v3/users/e132a0e22f85487d8e62faebeed067b1` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:12.085121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e132a0e22f85487d8e62faebeed067b1)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:12.087093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:12.141029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e132a0e22f85487d8e62faebeed067b1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.141923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e132a0e22f85487d8e62faebeed067b1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.142589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e132a0e22f85487d8e62faebeed067b1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.156148 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e132a0e22f85487d8e62faebeed067b1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.165960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e132a0e22f85487d8e62faebeed067b1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.180364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1354/2685] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:12 2022] DELETE /identity/v3/users/e132a0e22f85487d8e62faebeed067b1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:12.185015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ab35d-efd6-4db4-bac2-d7a074babb04 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:12.185686 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ab35d-efd6-4db4-bac2-d7a074babb04 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:12.185805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ab35d-efd6-4db4-bac2-d7a074babb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:12.203406 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-cf3ab35d-efd6-4db4-bac2-d7a074babb04 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:12.204883 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-cf3ab35d-efd6-4db4-bac2-d7a074babb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:12.268146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1332/2686] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:02:12.278259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:12.279849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:12.316333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:12.340992 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717d84-1137-4520-b9f4-b029dfdb7c32 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:12.344579 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da094aa-d7fb-4db9-a8d8-07ab3f3dd909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:12.345224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da094aa-d7fb-4db9-a8d8-07ab3f3dd909 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:12.345506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da094aa-d7fb-4db9-a8d8-07ab3f3dd909 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:12.345777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da094aa-d7fb-4db9-a8d8-07ab3f3dd909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:12.357041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da094aa-d7fb-4db9-a8d8-07ab3f3dd909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:12.358513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da094aa-d7fb-4db9-a8d8-07ab3f3dd909 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:12.369885 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1355/2687] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:12.658766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ab35d-efd6-4db4-bac2-d7a074babb04 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:12.660839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-cf3ab35d-efd6-4db4-bac2-d7a074babb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:12.681622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ab35d-efd6-4db4-bac2-d7a074babb04 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:12.688450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:12.689464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:12.689892 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:12.691316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] PATH_INFO: `/v3/projects/086114f132af44a1962cc49de410fb1d` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:12.692608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086114f132af44a1962cc49de410fb1d)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:12.694920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:12.705058 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=100 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:12.754854 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086114f132af44a1962cc49de410fb1d', 'request_id': 'req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.762526 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086114f132af44a1962cc49de410fb1d', 'request_id': 'req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.769576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086114f132af44a1962cc49de410fb1d', 'request_id': 'req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.780520 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] The token cache is being invalidate because project 086114f132af44a1962cc49de410fb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:12.780812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.781486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.783074 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1333/2688] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:12 2022] DELETE /identity/v3/projects/086114f132af44a1962cc49de410fb1d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:12.787831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da094aa-d7fb-4db9-a8d8-07ab3f3dd909 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:12.798215 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da094aa-d7fb-4db9-a8d8-07ab3f3dd909 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:12.860713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:12.862468 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:12.862908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:12.863286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] PATH_INFO: `/v3/users/ff9255b634fc4ba4bccae8aab5be1fa5` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:12.864674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9255b634fc4ba4bccae8aab5be1fa5)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:12.866679 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:12.917834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9255b634fc4ba4bccae8aab5be1fa5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.918481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9255b634fc4ba4bccae8aab5be1fa5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.919117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9255b634fc4ba4bccae8aab5be1fa5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.931769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9255b634fc4ba4bccae8aab5be1fa5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.938879 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-acc4e7ee-749d-46a1-aa05-b706712a8af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9255b634fc4ba4bccae8aab5be1fa5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:12.954704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1356/2689] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:12 2022] DELETE /identity/v3/users/ff9255b634fc4ba4bccae8aab5be1fa5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:13.406222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:13.408279 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:13.429094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31293d9-2955-4f1b-98f0-0ebb4ee8f672 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:13.505142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:13.506080 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:13.506498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:13.506846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] PATH_INFO: `/v3/projects/3b8ac805eada4191b3aab8df655eadc5` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:13.508183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8ac805eada4191b3aab8df655eadc5)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:13.510185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:13.572625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8ac805eada4191b3aab8df655eadc5', 'request_id': 'req-f3e38b49-4701-4c88-8130-8109979b455c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:13.582751 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8ac805eada4191b3aab8df655eadc5', 'request_id': 'req-f3e38b49-4701-4c88-8130-8109979b455c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:13.594833 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8ac805eada4191b3aab8df655eadc5', 'request_id': 'req-f3e38b49-4701-4c88-8130-8109979b455c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:13.606134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] The token cache is being invalidate because project 3b8ac805eada4191b3aab8df655eadc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:13.606478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:13.607181 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-f3e38b49-4701-4c88-8130-8109979b455c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:13.608867 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1334/2690] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:13 2022] DELETE /identity/v3/projects/3b8ac805eada4191b3aab8df655eadc5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:13.614715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc46de-1b70-4105-9537-1450aef9243a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:13.615289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc46de-1b70-4105-9537-1450aef9243a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:13.615698 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc46de-1b70-4105-9537-1450aef9243a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:13.634821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-8efc46de-1b70-4105-9537-1450aef9243a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:13.636188 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8efc46de-1b70-4105-9537-1450aef9243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:13.712045 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:13.727056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1357/2691] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:13.735019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015467a-3a3c-480b-a4e8-e506d1062870 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:13.735302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015467a-3a3c-480b-a4e8-e506d1062870 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:13.735580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015467a-3a3c-480b-a4e8-e506d1062870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:13.756109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-7015467a-3a3c-480b-a4e8-e506d1062870 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:13.757335 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-7015467a-3a3c-480b-a4e8-e506d1062870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:13.765294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1335/2692] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:13.770289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc46de-1b70-4105-9537-1450aef9243a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:13.780381 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc46de-1b70-4105-9537-1450aef9243a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:13.785528 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35eb1-7c71-4d56-bfb5-725d705e63a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:13.786192 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35eb1-7c71-4d56-bfb5-725d705e63a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:13.786503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35eb1-7c71-4d56-bfb5-725d705e63a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:13.786781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35eb1-7c71-4d56-bfb5-725d705e63a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:13.787505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35eb1-7c71-4d56-bfb5-725d705e63a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:02:13.787809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35eb1-7c71-4d56-bfb5-725d705e63a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:13.789433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35eb1-7c71-4d56-bfb5-725d705e63a8 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:13.801920 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1358/2693] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:02:13.805936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015467a-3a3c-480b-a4e8-e506d1062870 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:13.815429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015467a-3a3c-480b-a4e8-e506d1062870 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:13.820378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d88e19-8617-4e0a-8bdd-59c688eb1224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:13.821033 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d88e19-8617-4e0a-8bdd-59c688eb1224 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:13.821316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d88e19-8617-4e0a-8bdd-59c688eb1224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:13.821593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d88e19-8617-4e0a-8bdd-59c688eb1224 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:13.822291 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d88e19-8617-4e0a-8bdd-59c688eb1224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:13.824278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d88e19-8617-4e0a-8bdd-59c688eb1224 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:13.843868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:13.854111 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1336/2694] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:02:13 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:13.857950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35eb1-7c71-4d56-bfb5-725d705e63a8 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:13.868960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35eb1-7c71-4d56-bfb5-725d705e63a8 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:13.926960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58002dc5-de24-41ab-82c7-328e0b740596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:13.927623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58002dc5-de24-41ab-82c7-328e0b740596 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:13.927907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58002dc5-de24-41ab-82c7-328e0b740596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:13.928187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58002dc5-de24-41ab-82c7-328e0b740596 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:13.928870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58002dc5-de24-41ab-82c7-328e0b740596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:13.930823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58002dc5-de24-41ab-82c7-328e0b740596 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:13.952216 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1359/2695] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:02:13 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:02:13.957047 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d88e19-8617-4e0a-8bdd-59c688eb1224 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:13.967446 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d88e19-8617-4e0a-8bdd-59c688eb1224 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:13.972512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b4391-cec7-4148-9cb9-4d59568fb992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:13.973187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b4391-cec7-4148-9cb9-4d59568fb992 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:13.973474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b4391-cec7-4148-9cb9-4d59568fb992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:13.973757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b4391-cec7-4148-9cb9-4d59568fb992 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:13.974537 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b4391-cec7-4148-9cb9-4d59568fb992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:13.976186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b4391-cec7-4148-9cb9-4d59568fb992 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:13.990830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1337/2696] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:02:13.994968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58002dc5-de24-41ab-82c7-328e0b740596 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:14.006479 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58002dc5-de24-41ab-82c7-328e0b740596 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:14.011250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab4a639-326c-420d-ad5c-a31cf632c7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:14.011915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4a639-326c-420d-ad5c-a31cf632c7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.012199 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4a639-326c-420d-ad5c-a31cf632c7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.012484 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab4a639-326c-420d-ad5c-a31cf632c7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.013207 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4a639-326c-420d-ad5c-a31cf632c7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:14.014877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab4a639-326c-420d-ad5c-a31cf632c7d1 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:14.028760 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1360/2697] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:14.029910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b4391-cec7-4148-9cb9-4d59568fb992 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:14.040870 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b4391-cec7-4148-9cb9-4d59568fb992 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:14.045619 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338857-c7fe-468d-b736-e55c0637143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:14.046529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338857-c7fe-468d-b736-e55c0637143a admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.046808 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338857-c7fe-468d-b736-e55c0637143a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.047083 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b338857-c7fe-468d-b736-e55c0637143a admin admin] PATH_INFO: `/v3/projects/d531046dda374ec0a5ebadaf381a402b/users/67afdf68c1824321be33ee8d4734fd08/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.063210 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b338857-c7fe-468d-b736-e55c0637143a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d531046dda374ec0a5ebadaf381a402b, user_id=67afdf68c1824321be33ee8d4734fd08, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:14.066837 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b338857-c7fe-468d-b736-e55c0637143a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:14.083968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1338/2698] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:14 2022] PUT /identity/v3/projects/d531046dda374ec0a5ebadaf381a402b/users/67afdf68c1824321be33ee8d4734fd08/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:14.094154 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08819aa5-1d5f-46da-aed0-f7c1eb5803d5 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.094496 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08819aa5-1d5f-46da-aed0-f7c1eb5803d5 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.094846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08819aa5-1d5f-46da-aed0-f7c1eb5803d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.123962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-08819aa5-1d5f-46da-aed0-f7c1eb5803d5 None None] MFA Rules not processed for user `67afdf68c1824321be33ee8d4734fd08`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:14.125171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-08819aa5-1d5f-46da-aed0-f7c1eb5803d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:14.195688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1361/2699] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:14.199974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338857-c7fe-468d-b736-e55c0637143a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:14.270278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b338857-c7fe-468d-b736-e55c0637143a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:14.274953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5118aa1-a98e-43f9-8fa3-bd7dbe1ee304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:14.275606 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5118aa1-a98e-43f9-8fa3-bd7dbe1ee304 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.275888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5118aa1-a98e-43f9-8fa3-bd7dbe1ee304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.276166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5118aa1-a98e-43f9-8fa3-bd7dbe1ee304 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.277042 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5118aa1-a98e-43f9-8fa3-bd7dbe1ee304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:14.279013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5118aa1-a98e-43f9-8fa3-bd7dbe1ee304 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:14.308578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1339/2700] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:02:14 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:14.310058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08819aa5-1d5f-46da-aed0-f7c1eb5803d5 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:14.321569 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08819aa5-1d5f-46da-aed0-f7c1eb5803d5 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:14.372617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:14.383954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a71696-7747-4dd0-aea2-5fc4cc004064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:14.384633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71696-7747-4dd0-aea2-5fc4cc004064 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.384919 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71696-7747-4dd0-aea2-5fc4cc004064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.385232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a71696-7747-4dd0-aea2-5fc4cc004064 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.385942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a71696-7747-4dd0-aea2-5fc4cc004064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:14.387913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a71696-7747-4dd0-aea2-5fc4cc004064 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:14.408200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1362/2701] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:02:14 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:14.412924 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5118aa1-a98e-43f9-8fa3-bd7dbe1ee304 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:14.423302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5118aa1-a98e-43f9-8fa3-bd7dbe1ee304 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:14.428795 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602990d-62c3-4065-984c-c69b8d054221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:14.429459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602990d-62c3-4065-984c-c69b8d054221 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.429743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602990d-62c3-4065-984c-c69b8d054221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.430023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602990d-62c3-4065-984c-c69b8d054221 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.430798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602990d-62c3-4065-984c-c69b8d054221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:14.432409 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602990d-62c3-4065-984c-c69b8d054221 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:14.444199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1340/2702] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:14.447899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a71696-7747-4dd0-aea2-5fc4cc004064 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:14.459160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a71696-7747-4dd0-aea2-5fc4cc004064 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:14.463782 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82b0f3-fa68-4f55-9dd3-a59840d0aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:14.464657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82b0f3-fa68-4f55-9dd3-a59840d0aef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.464946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82b0f3-fa68-4f55-9dd3-a59840d0aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.465228 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82b0f3-fa68-4f55-9dd3-a59840d0aef1 admin admin] PATH_INFO: `/v3/projects/929e861906e945f0af3537a521ab2fd6/users/0fb599c96a7840e79878d9e6d3d097a2/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.481152 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82b0f3-fa68-4f55-9dd3-a59840d0aef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929e861906e945f0af3537a521ab2fd6, user_id=0fb599c96a7840e79878d9e6d3d097a2, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:14.483878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82b0f3-fa68-4f55-9dd3-a59840d0aef1 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:14.497623 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1363/2703] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:14 2022] PUT /identity/v3/projects/929e861906e945f0af3537a521ab2fd6/users/0fb599c96a7840e79878d9e6d3d097a2/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:02:14.501481 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602990d-62c3-4065-984c-c69b8d054221 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:14.512877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602990d-62c3-4065-984c-c69b8d054221 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:14.572164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b55be8-d728-411d-baab-a7bfa037ff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:14.572821 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b55be8-d728-411d-baab-a7bfa037ff6b admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.573108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b55be8-d728-411d-baab-a7bfa037ff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.573400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b55be8-d728-411d-baab-a7bfa037ff6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.574127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b55be8-d728-411d-baab-a7bfa037ff6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:14.575769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b55be8-d728-411d-baab-a7bfa037ff6b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:14.586668 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1341/2704] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:14.590776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82b0f3-fa68-4f55-9dd3-a59840d0aef1 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:14.601661 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82b0f3-fa68-4f55-9dd3-a59840d0aef1 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:14.606702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda97c9-f8ac-4822-b679-8c2c9a1d0c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:14.607577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda97c9-f8ac-4822-b679-8c2c9a1d0c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.607857 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda97c9-f8ac-4822-b679-8c2c9a1d0c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.608231 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda97c9-f8ac-4822-b679-8c2c9a1d0c73 admin admin] PATH_INFO: `/v3/projects/929e861906e945f0af3537a521ab2fd6/users/0fb599c96a7840e79878d9e6d3d097a2/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.610102 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda97c9-f8ac-4822-b679-8c2c9a1d0c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929e861906e945f0af3537a521ab2fd6, user_id=0fb599c96a7840e79878d9e6d3d097a2, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:14.613112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda97c9-f8ac-4822-b679-8c2c9a1d0c73 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:14.623478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1364/2705] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:14 2022] PUT /identity/v3/projects/929e861906e945f0af3537a521ab2fd6/users/0fb599c96a7840e79878d9e6d3d097a2/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:14.634624 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeac2d-aa5a-4562-bc98-352f07eca502 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.635002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeac2d-aa5a-4562-bc98-352f07eca502 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.635359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeac2d-aa5a-4562-bc98-352f07eca502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.667632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8ffeac2d-aa5a-4562-bc98-352f07eca502 None None] MFA Rules not processed for user `0fb599c96a7840e79878d9e6d3d097a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:14.668851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8ffeac2d-aa5a-4562-bc98-352f07eca502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:14.690592 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:14.751031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1342/2706] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:14.761927 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda97c9-f8ac-4822-b679-8c2c9a1d0c73 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:14.763775 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0fda97c9-f8ac-4822-b679-8c2c9a1d0c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:14.820414 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda97c9-f8ac-4822-b679-8c2c9a1d0c73 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:14.824061 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dc552-9b0d-488f-a53a-c82a4b24a9ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:14.824699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc552-9b0d-488f-a53a-c82a4b24a9ea service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:14.824980 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc552-9b0d-488f-a53a-c82a4b24a9ea service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:14.825257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc552-9b0d-488f-a53a-c82a4b24a9ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:14.880960 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dc552-9b0d-488f-a53a-c82a4b24a9ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:14.882407 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dc552-9b0d-488f-a53a-c82a4b24a9ea service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:14.891093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1365/2707] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:24.748013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=19 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:24.887174 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=69,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:25.510885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeac2d-aa5a-4562-bc98-352f07eca502 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:25.512600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8ffeac2d-aa5a-4562-bc98-352f07eca502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:25.541851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeac2d-aa5a-4562-bc98-352f07eca502 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:25.549096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1c1d1-549d-4163-8a74-abc36af98477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:25.549804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c1d1-549d-4163-8a74-abc36af98477 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:25.550145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c1d1-549d-4163-8a74-abc36af98477 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:25.550591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c1d1-549d-4163-8a74-abc36af98477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:25.561011 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1c1d1-549d-4163-8a74-abc36af98477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:25.562531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1c1d1-549d-4163-8a74-abc36af98477 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:25.574015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1343/2708] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:28.118653 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dc552-9b0d-488f-a53a-c82a4b24a9ea service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:28.120735 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-439dc552-9b0d-488f-a53a-c82a4b24a9ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:28.223695 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dc552-9b0d-488f-a53a-c82a4b24a9ea service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:28.227469 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e28e6e-d9d9-4817-bcc6-4221ae5cb4ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:28.228109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e28e6e-d9d9-4817-bcc6-4221ae5cb4ef service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:28.228979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e28e6e-d9d9-4817-bcc6-4221ae5cb4ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:28.229256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e28e6e-d9d9-4817-bcc6-4221ae5cb4ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:28.231032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-55e28e6e-d9d9-4817-bcc6-4221ae5cb4ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:28.393097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e28e6e-d9d9-4817-bcc6-4221ae5cb4ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:28.394594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e28e6e-d9d9-4817-bcc6-4221ae5cb4ef service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:28.426056 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1366/2709] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:02:30.591991 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1c1d1-549d-4163-8a74-abc36af98477 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:30.628039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1c1d1-549d-4163-8a74-abc36af98477 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:30.633547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:30.637135 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:30.637438 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:30.637814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] PATH_INFO: `/v3/users/67afdf68c1824321be33ee8d4734fd08` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:30.639321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67afdf68c1824321be33ee8d4734fd08)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:30.641185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:30.705028 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67afdf68c1824321be33ee8d4734fd08'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:30.706025 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67afdf68c1824321be33ee8d4734fd08'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:30.722784 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67afdf68c1824321be33ee8d4734fd08'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:30.731636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67afdf68c1824321be33ee8d4734fd08'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:30.741542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67afdf68c1824321be33ee8d4734fd08'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:30.748932 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1344/2710] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:30 2022] DELETE /identity/v3/users/67afdf68c1824321be33ee8d4734fd08 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:30.754137 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7709e-68d6-4977-8ebd-2af4a7e53362 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:30.754682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7709e-68d6-4977-8ebd-2af4a7e53362 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:30.754780 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7709e-68d6-4977-8ebd-2af4a7e53362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:30.783557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0fe7709e-68d6-4977-8ebd-2af4a7e53362 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:30.784822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0fe7709e-68d6-4977-8ebd-2af4a7e53362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:30.797902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:30.865159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1367/2711] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:30.877893 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:30.879519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:30.966593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730b430-ceec-402b-95f0-4d9d9e39dc78 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:30.971043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a69990-ee4f-4995-b56f-636e8a99d477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:30.971720 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a69990-ee4f-4995-b56f-636e8a99d477 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:30.972003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a69990-ee4f-4995-b56f-636e8a99d477 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:30.972278 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a69990-ee4f-4995-b56f-636e8a99d477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:30.984085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a69990-ee4f-4995-b56f-636e8a99d477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:30.985563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a69990-ee4f-4995-b56f-636e8a99d477 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:30.997681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1345/2712] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:31.501057 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7709e-68d6-4977-8ebd-2af4a7e53362 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:31.502544 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0fe7709e-68d6-4977-8ebd-2af4a7e53362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:31.516018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7709e-68d6-4977-8ebd-2af4a7e53362 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:31.521826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:31.522791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:31.523077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:31.523409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] PATH_INFO: `/v3/projects/d531046dda374ec0a5ebadaf381a402b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:31.524826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d531046dda374ec0a5ebadaf381a402b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:31.528405 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:31.626149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd531046dda374ec0a5ebadaf381a402b', 'request_id': 'req-671eb754-d912-4b0d-a2a2-d7f02c6fb460'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.643078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd531046dda374ec0a5ebadaf381a402b', 'request_id': 'req-671eb754-d912-4b0d-a2a2-d7f02c6fb460'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.654218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd531046dda374ec0a5ebadaf381a402b', 'request_id': 'req-671eb754-d912-4b0d-a2a2-d7f02c6fb460'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.678837 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] The token cache is being invalidate because project d531046dda374ec0a5ebadaf381a402b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:31.679364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.682615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.685783 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1368/2713] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:31 2022] DELETE /identity/v3/projects/d531046dda374ec0a5ebadaf381a402b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:31.691666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a69990-ee4f-4995-b56f-636e8a99d477 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:31.719534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a69990-ee4f-4995-b56f-636e8a99d477 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:31.775743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:31.835901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:31.836927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:31.837108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:31.837391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] PATH_INFO: `/v3/users/0fb599c96a7840e79878d9e6d3d097a2` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:31.840301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb599c96a7840e79878d9e6d3d097a2)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:31.842617 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:31.913430 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb599c96a7840e79878d9e6d3d097a2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.914425 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb599c96a7840e79878d9e6d3d097a2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.946707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb599c96a7840e79878d9e6d3d097a2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.958972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb599c96a7840e79878d9e6d3d097a2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.977533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb599c96a7840e79878d9e6d3d097a2'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:31.986196 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1346/2714] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:31 2022] DELETE /identity/v3/users/0fb599c96a7840e79878d9e6d3d097a2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:32.435002 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:32.438229 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:32.559440 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:32.561077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:32.561939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eb754-d912-4b0d-a2a2-d7f02c6fb460 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:32.627438 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:32.657290 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e558d-d393-4727-959e-5c5b0eb4ed8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:32.658054 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e558d-d393-4727-959e-5c5b0eb4ed8c service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:32.658434 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e558d-d393-4727-959e-5c5b0eb4ed8c service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:32.658809 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e558d-d393-4727-959e-5c5b0eb4ed8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:32.660740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-503e558d-d393-4727-959e-5c5b0eb4ed8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:32.673880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e558d-d393-4727-959e-5c5b0eb4ed8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:32.675638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e558d-d393-4727-959e-5c5b0eb4ed8c service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:32.682085 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a49dc3-8679-44cc-b6dd-24f412932fcd admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:32.688437 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1369/2715] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:32.688609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:32.689416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:32.689702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:32.690053 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] PATH_INFO: `/v3/projects/929e861906e945f0af3537a521ab2fd6` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:32.691211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=929e861906e945f0af3537a521ab2fd6)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:32.693163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:32.754346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929e861906e945f0af3537a521ab2fd6', 'request_id': 'req-6708c92a-e653-43d7-b5c2-0a8157031599'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:32.756012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:32.764043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929e861906e945f0af3537a521ab2fd6', 'request_id': 'req-6708c92a-e653-43d7-b5c2-0a8157031599'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:32.773020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929e861906e945f0af3537a521ab2fd6', 'request_id': 'req-6708c92a-e653-43d7-b5c2-0a8157031599'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:32.785639 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] The token cache is being invalidate because project 929e861906e945f0af3537a521ab2fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:32.786397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:32.788139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-6708c92a-e653-43d7-b5c2-0a8157031599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:32.789514 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1347/2716] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:32 2022] DELETE /identity/v3/projects/929e861906e945f0af3537a521ab2fd6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:02:32.796395 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3766c-74d8-4c10-8644-247eb4634162 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:32.796774 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3766c-74d8-4c10-8644-247eb4634162 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:32.797126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3766c-74d8-4c10-8644-247eb4634162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:32.840730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-bbf3766c-74d8-4c10-8644-247eb4634162 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:32.842162 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-bbf3766c-74d8-4c10-8644-247eb4634162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:32.919448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1370/2717] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:32.929558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6bf58-8a32-4093-9e5f-1612c1f7b7b4 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:32.929558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6bf58-8a32-4093-9e5f-1612c1f7b7b4 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:32.929558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6bf58-8a32-4093-9e5f-1612c1f7b7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:32.958600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-58f6bf58-8a32-4093-9e5f-1612c1f7b7b4 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:32.959975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-58f6bf58-8a32-4093-9e5f-1612c1f7b7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:32.971650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1348/2718] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:32.976261 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3766c-74d8-4c10-8644-247eb4634162 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:32.987512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3766c-74d8-4c10-8644-247eb4634162 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:32.992862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b335b5e-1706-4fd9-9ecb-3b037e27574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:32.993534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b335b5e-1706-4fd9-9ecb-3b037e27574c admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:32.994567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b335b5e-1706-4fd9-9ecb-3b037e27574c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:32.994851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b335b5e-1706-4fd9-9ecb-3b037e27574c admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:32.995762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b335b5e-1706-4fd9-9ecb-3b037e27574c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:02:32.996074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b335b5e-1706-4fd9-9ecb-3b037e27574c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:32.997753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b335b5e-1706-4fd9-9ecb-3b037e27574c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:33.010867 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1371/2719] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:02:33.015835 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6bf58-8a32-4093-9e5f-1612c1f7b7b4 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:33.025517 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6bf58-8a32-4093-9e5f-1612c1f7b7b4 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:33.030588 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b3214-462a-469d-be86-8594364ecf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:33.031604 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b3214-462a-469d-be86-8594364ecf51 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.031874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b3214-462a-469d-be86-8594364ecf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.032212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b3214-462a-469d-be86-8594364ecf51 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.033020 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b3214-462a-469d-be86-8594364ecf51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:33.035113 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b3214-462a-469d-be86-8594364ecf51 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:33.070292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1349/2720] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:02:33 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:33.074832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b335b5e-1706-4fd9-9ecb-3b037e27574c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:33.085677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b335b5e-1706-4fd9-9ecb-3b037e27574c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:33.192535 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8a43-5ac5-4e40-b7c3-b488eeeb45fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:33.193249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8a43-5ac5-4e40-b7c3-b488eeeb45fa admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.193539 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8a43-5ac5-4e40-b7c3-b488eeeb45fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.193825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c8a43-5ac5-4e40-b7c3-b488eeeb45fa admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.194563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c8a43-5ac5-4e40-b7c3-b488eeeb45fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:33.196505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c8a43-5ac5-4e40-b7c3-b488eeeb45fa admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:33.222422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1372/2721] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:02:33 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:33.223708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b3214-462a-469d-be86-8594364ecf51 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:33.235918 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b3214-462a-469d-be86-8594364ecf51 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:33.240957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0454930-7a68-46fc-9251-dd008278eb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:33.241709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454930-7a68-46fc-9251-dd008278eb1f admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.242067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454930-7a68-46fc-9251-dd008278eb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.242491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454930-7a68-46fc-9251-dd008278eb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.243295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0454930-7a68-46fc-9251-dd008278eb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:33.245236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0454930-7a68-46fc-9251-dd008278eb1f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:33.262492 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1350/2722] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:33.264000 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8a43-5ac5-4e40-b7c3-b488eeeb45fa admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:33.274891 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c8a43-5ac5-4e40-b7c3-b488eeeb45fa admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:33.280306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd54d23-2541-4f14-8768-0f636ba39a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:33.281034 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd54d23-2541-4f14-8768-0f636ba39a90 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.281324 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd54d23-2541-4f14-8768-0f636ba39a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.281601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd54d23-2541-4f14-8768-0f636ba39a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.282360 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd54d23-2541-4f14-8768-0f636ba39a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:33.283974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd54d23-2541-4f14-8768-0f636ba39a90 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:33.295471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1373/2723] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:33.300359 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0454930-7a68-46fc-9251-dd008278eb1f admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:33.312516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0454930-7a68-46fc-9251-dd008278eb1f admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:33.317910 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dea72c-fdf9-45b9-ba4b-689a97b543fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:33.318871 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dea72c-fdf9-45b9-ba4b-689a97b543fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.319246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dea72c-fdf9-45b9-ba4b-689a97b543fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.319650 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dea72c-fdf9-45b9-ba4b-689a97b543fa admin admin] PATH_INFO: `/v3/projects/3343f7d0f72e4047b185a009be5f37e1/users/139c34ba08ae416c882bd4ef119f40fc/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.338984 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dea72c-fdf9-45b9-ba4b-689a97b543fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3343f7d0f72e4047b185a009be5f37e1, user_id=139c34ba08ae416c882bd4ef119f40fc, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:33.341648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dea72c-fdf9-45b9-ba4b-689a97b543fa admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:33.357708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1351/2724] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:33 2022] PUT /identity/v3/projects/3343f7d0f72e4047b185a009be5f37e1/users/139c34ba08ae416c882bd4ef119f40fc/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:33.430502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924f008-d793-4b5b-a2c4-077b261c4a1d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.430702 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924f008-d793-4b5b-a2c4-077b261c4a1d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.430971 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924f008-d793-4b5b-a2c4-077b261c4a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.466672 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-0924f008-d793-4b5b-a2c4-077b261c4a1d None None] MFA Rules not processed for user `139c34ba08ae416c882bd4ef119f40fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:33.468078 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-0924f008-d793-4b5b-a2c4-077b261c4a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:33.484712 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:33.574635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1374/2725] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:33.580193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dea72c-fdf9-45b9-ba4b-689a97b543fa admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:33.702630 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dea72c-fdf9-45b9-ba4b-689a97b543fa admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:33.718091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405ae58-5cc9-49f3-b88b-9d556c3b4ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:33.718868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405ae58-5cc9-49f3-b88b-9d556c3b4ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.719151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405ae58-5cc9-49f3-b88b-9d556c3b4ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.719429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405ae58-5cc9-49f3-b88b-9d556c3b4ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.720138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405ae58-5cc9-49f3-b88b-9d556c3b4ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:33.722248 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405ae58-5cc9-49f3-b88b-9d556c3b4ba9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:33.762347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1352/2726] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:02:33 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:33.770858 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924f008-d793-4b5b-a2c4-077b261c4a1d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:33.791787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924f008-d793-4b5b-a2c4-077b261c4a1d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:33.918847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d7196-1c58-4af5-a0c7-46d133babf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:33.919694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d7196-1c58-4af5-a0c7-46d133babf69 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.920105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d7196-1c58-4af5-a0c7-46d133babf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.920741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d7196-1c58-4af5-a0c7-46d133babf69 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.921533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d7196-1c58-4af5-a0c7-46d133babf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:33.923541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d7196-1c58-4af5-a0c7-46d133babf69 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:33.953436 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1375/2727] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:02:33 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:02:33.958533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405ae58-5cc9-49f3-b88b-9d556c3b4ba9 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:33.972394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405ae58-5cc9-49f3-b88b-9d556c3b4ba9 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:33.977622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69896-2521-4f5e-9c9f-e2204499cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:33.979013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69896-2521-4f5e-9c9f-e2204499cb2a admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.979295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69896-2521-4f5e-9c9f-e2204499cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.979682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b69896-2521-4f5e-9c9f-e2204499cb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.980689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b69896-2521-4f5e-9c9f-e2204499cb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:33.983096 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b69896-2521-4f5e-9c9f-e2204499cb2a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:34.002311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1353/2728] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:34.004058 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d7196-1c58-4af5-a0c7-46d133babf69 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:34.015881 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d7196-1c58-4af5-a0c7-46d133babf69 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:34.021103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ae05-c311-4026-8452-ce27c4eacc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:34.022225 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ae05-c311-4026-8452-ce27c4eacc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:34.022622 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ae05-c311-4026-8452-ce27c4eacc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:34.022909 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ae05-c311-4026-8452-ce27c4eacc67 admin admin] PATH_INFO: `/v3/projects/fed839c7984849b2a85fa3fc391ebe0f/users/a9b62b9c49794f9fa6bdd8de57b67e7a/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:34.047354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1ae05-c311-4026-8452-ce27c4eacc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed839c7984849b2a85fa3fc391ebe0f, user_id=a9b62b9c49794f9fa6bdd8de57b67e7a, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:34.050532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1ae05-c311-4026-8452-ce27c4eacc67 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:34.070477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1376/2729] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:34 2022] PUT /identity/v3/projects/fed839c7984849b2a85fa3fc391ebe0f/users/a9b62b9c49794f9fa6bdd8de57b67e7a/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:34.077912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69896-2521-4f5e-9c9f-e2204499cb2a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:34.091713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b69896-2521-4f5e-9c9f-e2204499cb2a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:34.173214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:34.203356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6fd9c-bfc0-4fe1-b292-dac9b38e2fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:34.204598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fd9c-bfc0-4fe1-b292-dac9b38e2fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:34.205362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fd9c-bfc0-4fe1-b292-dac9b38e2fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:34.205362 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6fd9c-bfc0-4fe1-b292-dac9b38e2fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:34.206817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6fd9c-bfc0-4fe1-b292-dac9b38e2fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:34.209332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6fd9c-bfc0-4fe1-b292-dac9b38e2fa9 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:34.224771 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1354/2730] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:02:34.230835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ae05-c311-4026-8452-ce27c4eacc67 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:34.246889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ae05-c311-4026-8452-ce27c4eacc67 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:34.253918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd6fe-74f7-4ce8-8d70-61d383eb1486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:34.255189 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd6fe-74f7-4ce8-8d70-61d383eb1486 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:34.255692 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd6fe-74f7-4ce8-8d70-61d383eb1486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:34.256193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abd6fe-74f7-4ce8-8d70-61d383eb1486 admin admin] PATH_INFO: `/v3/projects/fed839c7984849b2a85fa3fc391ebe0f/users/a9b62b9c49794f9fa6bdd8de57b67e7a/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:34.258631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd6fe-74f7-4ce8-8d70-61d383eb1486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed839c7984849b2a85fa3fc391ebe0f, user_id=a9b62b9c49794f9fa6bdd8de57b67e7a, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:34.262807 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abd6fe-74f7-4ce8-8d70-61d383eb1486 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:34.279161 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1377/2731] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:02:34 2022] PUT /identity/v3/projects/fed839c7984849b2a85fa3fc391ebe0f/users/a9b62b9c49794f9fa6bdd8de57b67e7a/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:34.292551 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432d30d-2f65-41e0-9886-2c26f4dcf3c5 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:34.293040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432d30d-2f65-41e0-9886-2c26f4dcf3c5 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:34.293615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432d30d-2f65-41e0-9886-2c26f4dcf3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:34.335302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-4432d30d-2f65-41e0-9886-2c26f4dcf3c5 None None] MFA Rules not processed for user `a9b62b9c49794f9fa6bdd8de57b67e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:34.336874 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4432d30d-2f65-41e0-9886-2c26f4dcf3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:34.437163 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1355/2732] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:02:34.445112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd6fe-74f7-4ce8-8d70-61d383eb1486 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:34.447092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-99abd6fe-74f7-4ce8-8d70-61d383eb1486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:34.521333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abd6fe-74f7-4ce8-8d70-61d383eb1486 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:34.526576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad374c-743a-4937-9ce2-db93cc7a0548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:34.527259 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad374c-743a-4937-9ce2-db93cc7a0548 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:34.527555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad374c-743a-4937-9ce2-db93cc7a0548 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:34.527835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad374c-743a-4937-9ce2-db93cc7a0548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:34.550501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:34.608729 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad374c-743a-4937-9ce2-db93cc7a0548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:34.610432 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad374c-743a-4937-9ce2-db93cc7a0548 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:34.621248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1378/2733] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:36.338187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432d30d-2f65-41e0-9886-2c26f4dcf3c5 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:36.339741 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-4432d30d-2f65-41e0-9886-2c26f4dcf3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:36.409512 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432d30d-2f65-41e0-9886-2c26f4dcf3c5 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:36.414133 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:36.415061 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:36.415341 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:36.416373 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] PATH_INFO: `/v3/users/10ae039c34c442f880c51aaf9024db8d` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:36.417638 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ae039c34c442f880c51aaf9024db8d)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:36.419621 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:36.467172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ae039c34c442f880c51aaf9024db8d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.467768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ae039c34c442f880c51aaf9024db8d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.481031 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ae039c34c442f880c51aaf9024db8d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.486467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:36.488965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ae039c34c442f880c51aaf9024db8d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.497782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ae039c34c442f880c51aaf9024db8d'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.504533 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1356/2734] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:36 2022] DELETE /identity/v3/users/10ae039c34c442f880c51aaf9024db8d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:36.689170 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad374c-743a-4937-9ce2-db93cc7a0548 service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:36.701759 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad374c-743a-4937-9ce2-db93cc7a0548 service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:36.785224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:36.786615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:36.787062 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:36.787499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] PATH_INFO: `/v3/projects/79dbb107721b4406b5c3e2f5081034fd` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:36.789314 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79dbb107721b4406b5c3e2f5081034fd)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:36.792626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:36.846788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79dbb107721b4406b5c3e2f5081034fd', 'request_id': 'req-65dbfdd9-cd80-4055-9933-75e4155d65e5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.854504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79dbb107721b4406b5c3e2f5081034fd', 'request_id': 'req-65dbfdd9-cd80-4055-9933-75e4155d65e5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.861197 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79dbb107721b4406b5c3e2f5081034fd', 'request_id': 'req-65dbfdd9-cd80-4055-9933-75e4155d65e5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.873079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] The token cache is being invalidate because project 79dbb107721b4406b5c3e2f5081034fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:36.873373 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.874071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:36.875663 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1379/2735] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:36 2022] DELETE /identity/v3/projects/79dbb107721b4406b5c3e2f5081034fd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:36.879770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:36.881189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:36.896018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accfca1-d3bb-4fb6-88fb-b769db89f23d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:36.961727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:36.963299 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:36.964293 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:36.964577 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] PATH_INFO: `/v3/users/11cfca6196fe4cc7a0138b6682c69922` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:36.965911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11cfca6196fe4cc7a0138b6682c69922)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:36.967985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:37.024890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11cfca6196fe4cc7a0138b6682c69922'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.025816 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11cfca6196fe4cc7a0138b6682c69922'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.042428 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11cfca6196fe4cc7a0138b6682c69922'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.050791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11cfca6196fe4cc7a0138b6682c69922'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.060954 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11cfca6196fe4cc7a0138b6682c69922'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.071222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1357/2736] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:36 2022] DELETE /identity/v3/users/11cfca6196fe4cc7a0138b6682c69922 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:37.322846 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:37.324450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:37.339350 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbfdd9-cd80-4055-9933-75e4155d65e5 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:37.397264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:37.412082 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:37.412978 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:37.413263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:37.413586 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] PATH_INFO: `/v3/projects/67d8230adaba4186b21de3a7853b883f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:37.414796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d8230adaba4186b21de3a7853b883f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:37.417071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:37.472403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d8230adaba4186b21de3a7853b883f', 'request_id': 'req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.481077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d8230adaba4186b21de3a7853b883f', 'request_id': 'req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.487648 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d8230adaba4186b21de3a7853b883f', 'request_id': 'req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.498787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] The token cache is being invalidate because project 67d8230adaba4186b21de3a7853b883f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:37.499079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.499720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7ee70a08-de4f-4c60-9f9e-e11b18f7f148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:37.501243 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1380/2737] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:37 2022] DELETE /identity/v3/projects/67d8230adaba4186b21de3a7853b883f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:39.378267 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:39.379807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:39.393596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97526e9e-9d98-4182-9661-9b1b45bacbe5 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:39.457263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:39.458649 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:39.459141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:39.459609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] PATH_INFO: `/v3/users/139c34ba08ae416c882bd4ef119f40fc` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:39.461656 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139c34ba08ae416c882bd4ef119f40fc)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:39.465354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:39.478699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:39.521071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139c34ba08ae416c882bd4ef119f40fc'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:39.521823 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139c34ba08ae416c882bd4ef119f40fc'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:39.535550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139c34ba08ae416c882bd4ef119f40fc'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:39.543576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139c34ba08ae416c882bd4ef119f40fc'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:39.555183 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139c34ba08ae416c882bd4ef119f40fc'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:39.561694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1358/2738] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:39 2022] DELETE /identity/v3/users/139c34ba08ae416c882bd4ef119f40fc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:39.566627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee2d1-6cfc-4fe8-897e-6036cef6df89 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:39.567124 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee2d1-6cfc-4fe8-897e-6036cef6df89 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:39.567227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ee2d1-6cfc-4fe8-897e-6036cef6df89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:39.588818 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-979ee2d1-6cfc-4fe8-897e-6036cef6df89 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:39.590127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-979ee2d1-6cfc-4fe8-897e-6036cef6df89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:39.659384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1381/2739] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:39.674037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:39.675986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:39.779712 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec03a3-3fcd-4f71-8030-18fdae86de90 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:39.784305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e78f0-e378-4338-b53a-c872dd4b31de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:39.785139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e78f0-e378-4338-b53a-c872dd4b31de service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:39.785482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e78f0-e378-4338-b53a-c872dd4b31de service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:39.785763 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e78f0-e378-4338-b53a-c872dd4b31de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:39.797673 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e78f0-e378-4338-b53a-c872dd4b31de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:39.799173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e78f0-e378-4338-b53a-c872dd4b31de service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:39.811447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1359/2740] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:40.131532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ee2d1-6cfc-4fe8-897e-6036cef6df89 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:40.133805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-979ee2d1-6cfc-4fe8-897e-6036cef6df89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:40.153524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ee2d1-6cfc-4fe8-897e-6036cef6df89 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:40.159271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:40.160295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:40.160680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:40.161081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] PATH_INFO: `/v3/projects/3343f7d0f72e4047b185a009be5f37e1` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:40.162454 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3343f7d0f72e4047b185a009be5f37e1)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:40.164443 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:40.225128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3343f7d0f72e4047b185a009be5f37e1', 'request_id': 'req-da32a13c-fcc0-486c-b66e-ede0104ac0a6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.236072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3343f7d0f72e4047b185a009be5f37e1', 'request_id': 'req-da32a13c-fcc0-486c-b66e-ede0104ac0a6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.244462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3343f7d0f72e4047b185a009be5f37e1', 'request_id': 'req-da32a13c-fcc0-486c-b66e-ede0104ac0a6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.258427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] The token cache is being invalidate because project 3343f7d0f72e4047b185a009be5f37e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:40.258427 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.259366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.261494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1382/2741] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:40 2022] DELETE /identity/v3/projects/3343f7d0f72e4047b185a009be5f37e1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:40.265919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e78f0-e378-4338-b53a-c872dd4b31de service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:40.277553 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e78f0-e378-4338-b53a-c872dd4b31de service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:40.349728 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:40.351138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:40.351138 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:40.351375 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] PATH_INFO: `/v3/users/a9b62b9c49794f9fa6bdd8de57b67e7a` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:40.352525 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9b62b9c49794f9fa6bdd8de57b67e7a)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:40.354667 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:40.393896 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:40.409012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b62b9c49794f9fa6bdd8de57b67e7a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.410576 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b62b9c49794f9fa6bdd8de57b67e7a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.424496 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b62b9c49794f9fa6bdd8de57b67e7a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.434635 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b62b9c49794f9fa6bdd8de57b67e7a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.442311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-34fbc87e-9ad1-408c-9d63-8078dd3d526b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b62b9c49794f9fa6bdd8de57b67e7a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.450356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1360/2742] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:02:40 2022] DELETE /identity/v3/users/a9b62b9c49794f9fa6bdd8de57b67e7a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:40.755234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:40.756710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:40.766227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:40.771449 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32a13c-fcc0-486c-b66e-ede0104ac0a6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:40.843634 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:40.844509 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:40.844791 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:40.845072 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] PATH_INFO: `/v3/projects/fed839c7984849b2a85fa3fc391ebe0f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:40.846311 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed839c7984849b2a85fa3fc391ebe0f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:40.848279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:40.903422 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed839c7984849b2a85fa3fc391ebe0f', 'request_id': 'req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.911638 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed839c7984849b2a85fa3fc391ebe0f', 'request_id': 'req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.919762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed839c7984849b2a85fa3fc391ebe0f', 'request_id': 'req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.933710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] The token cache is being invalidate because project fed839c7984849b2a85fa3fc391ebe0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:02:40.934003 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.934710 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:02:40.936295 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1383/2743] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:02:40 2022] DELETE /identity/v3/projects/fed839c7984849b2a85fa3fc391ebe0f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:02:44.942253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30706e67-8171-4565-afb0-e0774addd69b None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:44.942813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30706e67-8171-4565-afb0-e0774addd69b None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:44.942936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30706e67-8171-4565-afb0-e0774addd69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:44.960736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-30706e67-8171-4565-afb0-e0774addd69b None None] MFA Rules not processed for user `a016506e3a104467bc09926acfba95b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:44.961959 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-30706e67-8171-4565-afb0-e0774addd69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:45.020381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1361/2744] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:02:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:45.287041 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:45.289877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:45.374597 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3ed13-c42c-4b12-a2f8-4c52101a0a22 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:45.378866 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:45.379766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:45.380159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:45.380537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:45.382715 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:45.395301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:45.396835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:45.407418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1384/2745] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:02:45.798218 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30706e67-8171-4565-afb0-e0774addd69b None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:45.800349 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-30706e67-8171-4565-afb0-e0774addd69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:45.895747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30706e67-8171-4565-afb0-e0774addd69b None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:45.901876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:45.902570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:45.902859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:45.903141 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:45.905134 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:45.919175 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:45.920819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:45.935607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1362/2746] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:53.537966 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:53.540325 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:53.611618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:53.667031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b02aa5-38d6-450c-a413-76699ba3e4e1 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:53.673046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399887a9-d5c5-471b-b079-b5b662e8cfbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:53.673721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399887a9-d5c5-471b-b079-b5b662e8cfbb service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:53.674035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399887a9-d5c5-471b-b079-b5b662e8cfbb service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:53.674276 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399887a9-d5c5-471b-b079-b5b662e8cfbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:53.676633 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-399887a9-d5c5-471b-b079-b5b662e8cfbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:53.690626 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399887a9-d5c5-471b-b079-b5b662e8cfbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:53.692282 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399887a9-d5c5-471b-b079-b5b662e8cfbb service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:53.708540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1385/2747] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:55.928151 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=74,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:03.193102 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:03.195610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:03.314703 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15a030-2a06-424c-8835-86e6313e7ad9 service placement] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:03.321027 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065bb8c-7120-43c1-8822-4ac46e8b54ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:03.323369 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065bb8c-7120-43c1-8822-4ac46e8b54ed service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:03.323865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065bb8c-7120-43c1-8822-4ac46e8b54ed service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:03.324355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065bb8c-7120-43c1-8822-4ac46e8b54ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:03.327695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3065bb8c-7120-43c1-8822-4ac46e8b54ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:03.427064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065bb8c-7120-43c1-8822-4ac46e8b54ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:03.428659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065bb8c-7120-43c1-8822-4ac46e8b54ed service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:03.441320 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1363/2748] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:03.700481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=18 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:09.799984 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399887a9-d5c5-471b-b079-b5b662e8cfbb service nova] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:09.828958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399887a9-d5c5-471b-b079-b5b662e8cfbb service nova] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:09.834576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:09.835245 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:09.835531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:09.835811 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:09.837976 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:09.875946 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:09.879075 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:09.902580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1386/2749] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:03:13.435924 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=48 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:13.662424 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21affc5-0e73-4a85-91c0-7f95483138c3 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:13.662963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21affc5-0e73-4a85-91c0-7f95483138c3 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:13.663457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21affc5-0e73-4a85-91c0-7f95483138c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:13.695012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-f21affc5-0e73-4a85-91c0-7f95483138c3 None None] MFA Rules not processed for user `845a039c954f4384917100206698d015`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:13.697342 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f21affc5-0e73-4a85-91c0-7f95483138c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:13.712275 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1364/2750] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:19.892406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=15 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:23.683922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:54.985871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:54.988103 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:55.090035 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482608c-ebf4-4adc-8687-e11baec0fdf0 service placement] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:55.094834 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:55.096007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:55.096440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:55.096818 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] PATH_INFO: `/v3/users/a016506e3a104467bc09926acfba95b6` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:55.098474 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a016506e3a104467bc09926acfba95b6)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:55.102118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:55.170875 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a016506e3a104467bc09926acfba95b6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.171492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a016506e3a104467bc09926acfba95b6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.172105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a016506e3a104467bc09926acfba95b6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.186813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a016506e3a104467bc09926acfba95b6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.196567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a016506e3a104467bc09926acfba95b6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.214351 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1387/2751] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:03:54 2022] DELETE /identity/v3/users/a016506e3a104467bc09926acfba95b6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:03:55.444710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21affc5-0e73-4a85-91c0-7f95483138c3 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:55.466641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21affc5-0e73-4a85-91c0-7f95483138c3 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:55.556046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:55.556937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:55.557226 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:55.557516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] PATH_INFO: `/v3/projects/2a493f8e913a46c0bbc188ba94b91135` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:55.559039 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a493f8e913a46c0bbc188ba94b91135)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:55.561002 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:55.634166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a493f8e913a46c0bbc188ba94b91135', 'request_id': 'req-694001d3-5b56-4df5-a049-b5bbe1b74d3c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.644782 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a493f8e913a46c0bbc188ba94b91135', 'request_id': 'req-694001d3-5b56-4df5-a049-b5bbe1b74d3c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.655304 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a493f8e913a46c0bbc188ba94b91135', 'request_id': 'req-694001d3-5b56-4df5-a049-b5bbe1b74d3c'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.667459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] The token cache is being invalidate because project 2a493f8e913a46c0bbc188ba94b91135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:03:55.667849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.668593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:03:55.670350 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1365/2752] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:03:55 2022] DELETE /identity/v3/projects/2a493f8e913a46c0bbc188ba94b91135 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:04:05.208749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:05.663671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:04.972171 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:04.974506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:05.080212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945e02b-efab-45bb-ba2e-2d08fc7dc4a6 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:05.154115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:05.155144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:05.155641 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:05.156142 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:05.159344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:05.286676 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:05.288829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:05.315674 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1388/2753] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:13.754356 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:13.757461 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:13.779563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694001d3-5b56-4df5-a049-b5bbe1b74d3c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:13.785431 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:13.786633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:13.787957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:13.788448 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:13.792164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:13.816013 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:13.817559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:13.838199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1366/2754] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:15.312668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:23.829040 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:25.730486 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:25.732356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:25.796039 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185f322-9cbd-4f43-a2eb-456bc9dbb5a5 service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:25.799816 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:25.801964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:25.801964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:25.801964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:25.803042 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:25.883107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:25.884561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:25.897032 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1389/2755] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:30.247752 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:30.249328 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:30.358751 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:30.363703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:30.381516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a75e47-d518-4b1d-99f7-0ccb87dbced0 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:30.390236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f65e44-bcb1-4f1e-91ac-e7ed424b9ebc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:30.391391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f65e44-bcb1-4f1e-91ac-e7ed424b9ebc service placement] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:30.391736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f65e44-bcb1-4f1e-91ac-e7ed424b9ebc service placement] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:30.392128 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f65e44-bcb1-4f1e-91ac-e7ed424b9ebc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:30.394962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-32f65e44-bcb1-4f1e-91ac-e7ed424b9ebc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:30.398592 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1b81d-a9b5-4582-bad5-71a11a5d46ab service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:30.406534 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:30.408055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:30.408743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:30.409803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] PATH_INFO: `/v3/users/845a039c954f4384917100206698d015` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:30.411165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=845a039c954f4384917100206698d015)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:30.414028 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:30.415704 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f65e44-bcb1-4f1e-91ac-e7ed424b9ebc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:30.417812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f65e44-bcb1-4f1e-91ac-e7ed424b9ebc service placement] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:30.434569 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1367/2756] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:30.486210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845a039c954f4384917100206698d015'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:30.487008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845a039c954f4384917100206698d015'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:30.487686 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845a039c954f4384917100206698d015'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:30.511232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845a039c954f4384917100206698d015'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:30.526117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e93dc829-3563-4dae-8ecf-85efb4301555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845a039c954f4384917100206698d015'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:30.553445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1390/2757] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:30 2022] DELETE /identity/v3/users/845a039c954f4384917100206698d015 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:30.810522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f65e44-bcb1-4f1e-91ac-e7ed424b9ebc service placement] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:30.828723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f65e44-bcb1-4f1e-91ac-e7ed424b9ebc service placement] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:30.926570 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:30.927474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:30.928294 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:30.928559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] PATH_INFO: `/v3/projects/737af05e60014fe88e0238e00afb39c6` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:30.929889 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=737af05e60014fe88e0238e00afb39c6)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:30.931897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:30.998979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '737af05e60014fe88e0238e00afb39c6', 'request_id': 'req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:31.008961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '737af05e60014fe88e0238e00afb39c6', 'request_id': 'req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:31.022402 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '737af05e60014fe88e0238e00afb39c6', 'request_id': 'req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:31.043866 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] The token cache is being invalidate because project 737af05e60014fe88e0238e00afb39c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:31.044217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:31.044826 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-7f6a72e4-dabd-4f0b-bb60-af5de713fe3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:31.046506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1368/2758] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:30 2022] DELETE /identity/v3/projects/737af05e60014fe88e0238e00afb39c6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:31.052390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7dd3-aea9-4e9f-ac35-2c0f8689bf6a None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.052814 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7dd3-aea9-4e9f-ac35-2c0f8689bf6a None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.053263 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd7dd3-aea9-4e9f-ac35-2c0f8689bf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.094825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-79dd7dd3-aea9-4e9f-ac35-2c0f8689bf6a None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:31.097147 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-79dd7dd3-aea9-4e9f-ac35-2c0f8689bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:31.110363 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:31.192932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1391/2759] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:31.206725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430cded-2a96-41da-b305-8d59fe0beb85 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.207470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430cded-2a96-41da-b305-8d59fe0beb85 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.208157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430cded-2a96-41da-b305-8d59fe0beb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.242535 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c430cded-2a96-41da-b305-8d59fe0beb85 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:31.243848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c430cded-2a96-41da-b305-8d59fe0beb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:31.253644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1369/2760] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:31.259883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd7dd3-aea9-4e9f-ac35-2c0f8689bf6a None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:31.279063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd7dd3-aea9-4e9f-ac35-2c0f8689bf6a None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:31.285325 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcfeaf-7be9-40a2-8918-9d15fd920f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:31.286081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcfeaf-7be9-40a2-8918-9d15fd920f5a admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.286492 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcfeaf-7be9-40a2-8918-9d15fd920f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.287008 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcfeaf-7be9-40a2-8918-9d15fd920f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.288538 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcfeaf-7be9-40a2-8918-9d15fd920f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:31.289087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcfeaf-7be9-40a2-8918-9d15fd920f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:31.290929 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcfeaf-7be9-40a2-8918-9d15fd920f5a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:31.305440 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1392/2761] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:31.310301 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430cded-2a96-41da-b305-8d59fe0beb85 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:31.322381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430cded-2a96-41da-b305-8d59fe0beb85 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:31.328007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ea3f-8bcf-4ebf-9eed-3cedd749bf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:31.328685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ea3f-8bcf-4ebf-9eed-3cedd749bf6d admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.328971 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ea3f-8bcf-4ebf-9eed-3cedd749bf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.329252 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ea3f-8bcf-4ebf-9eed-3cedd749bf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.329961 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8ea3f-8bcf-4ebf-9eed-3cedd749bf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:31.332459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8ea3f-8bcf-4ebf-9eed-3cedd749bf6d admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:31.345049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:31.372286 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1370/2762] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:31 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:31.374954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcfeaf-7be9-40a2-8918-9d15fd920f5a admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:31.390935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcfeaf-7be9-40a2-8918-9d15fd920f5a admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:31.471731 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86caeeb-de5a-4eb4-bf84-20d1c2006b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:31.472766 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86caeeb-de5a-4eb4-bf84-20d1c2006b74 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.473224 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86caeeb-de5a-4eb4-bf84-20d1c2006b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.473635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86caeeb-de5a-4eb4-bf84-20d1c2006b74 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.475086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86caeeb-de5a-4eb4-bf84-20d1c2006b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:31.478803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86caeeb-de5a-4eb4-bf84-20d1c2006b74 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:31.511894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1393/2763] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:31 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:31.517913 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ea3f-8bcf-4ebf-9eed-3cedd749bf6d admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:31.531209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ea3f-8bcf-4ebf-9eed-3cedd749bf6d admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:31.536879 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d9623-1535-4384-b260-8a04be651cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:31.537730 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d9623-1535-4384-b260-8a04be651cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.538129 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d9623-1535-4384-b260-8a04be651cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.538641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d9623-1535-4384-b260-8a04be651cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.539508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d9623-1535-4384-b260-8a04be651cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:31.541584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d9623-1535-4384-b260-8a04be651cb3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:31.558100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1371/2764] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:31.563077 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86caeeb-de5a-4eb4-bf84-20d1c2006b74 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:31.576341 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86caeeb-de5a-4eb4-bf84-20d1c2006b74 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:31.581769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242d148-e2da-42e5-b4d3-a951a9f644b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:31.583004 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242d148-e2da-42e5-b4d3-a951a9f644b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.583372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242d148-e2da-42e5-b4d3-a951a9f644b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.583802 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242d148-e2da-42e5-b4d3-a951a9f644b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.585131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242d148-e2da-42e5-b4d3-a951a9f644b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:31.586880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242d148-e2da-42e5-b4d3-a951a9f644b4 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:31.598409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1394/2765] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:31.604118 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d9623-1535-4384-b260-8a04be651cb3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:31.620779 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d9623-1535-4384-b260-8a04be651cb3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:31.626250 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8123b88-802c-431f-91ae-1d5ce478896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:31.627188 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8123b88-802c-431f-91ae-1d5ce478896e admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.627465 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8123b88-802c-431f-91ae-1d5ce478896e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.627739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8123b88-802c-431f-91ae-1d5ce478896e admin admin] PATH_INFO: `/v3/projects/d21ae22b7b884feab3d6c70c7b0c6785/users/85a2506bfef548dfbd3e230a80a802c3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.647300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8123b88-802c-431f-91ae-1d5ce478896e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21ae22b7b884feab3d6c70c7b0c6785, user_id=85a2506bfef548dfbd3e230a80a802c3, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:31.649814 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8123b88-802c-431f-91ae-1d5ce478896e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:31.665598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1372/2766] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:31 2022] PUT /identity/v3/projects/d21ae22b7b884feab3d6c70c7b0c6785/users/85a2506bfef548dfbd3e230a80a802c3/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:31.678500 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc75c2-1cf2-4399-8294-5c00a269b183 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.679355 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc75c2-1cf2-4399-8294-5c00a269b183 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.679829 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc75c2-1cf2-4399-8294-5c00a269b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.727179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-fafc75c2-1cf2-4399-8294-5c00a269b183 None None] MFA Rules not processed for user `85a2506bfef548dfbd3e230a80a802c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:31.728570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-fafc75c2-1cf2-4399-8294-5c00a269b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:31.802578 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1395/2767] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:31.808269 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8123b88-802c-431f-91ae-1d5ce478896e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:31.885777 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8123b88-802c-431f-91ae-1d5ce478896e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:31.891447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9f9ba-e109-4224-aedc-dd47bdde0049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:31.892414 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9f9ba-e109-4224-aedc-dd47bdde0049 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:31.892560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9f9ba-e109-4224-aedc-dd47bdde0049 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:31.892849 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9f9ba-e109-4224-aedc-dd47bdde0049 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:31.893616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9f9ba-e109-4224-aedc-dd47bdde0049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:31.895603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9f9ba-e109-4224-aedc-dd47bdde0049 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:31.930584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1373/2768] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:31 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:31.936131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc75c2-1cf2-4399-8294-5c00a269b183 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:31.955311 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc75c2-1cf2-4399-8294-5c00a269b183 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:31.962481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:32.044023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace5ed9-2543-439c-a8e4-ca6746aa9ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:32.045117 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace5ed9-2543-439c-a8e4-ca6746aa9ced admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:32.045601 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace5ed9-2543-439c-a8e4-ca6746aa9ced admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:32.046081 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace5ed9-2543-439c-a8e4-ca6746aa9ced admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:32.047374 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace5ed9-2543-439c-a8e4-ca6746aa9ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:32.050958 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace5ed9-2543-439c-a8e4-ca6746aa9ced admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:32.086333 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1396/2769] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:31 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:32.092519 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9f9ba-e109-4224-aedc-dd47bdde0049 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:32.104641 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9f9ba-e109-4224-aedc-dd47bdde0049 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:32.109926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f5df-1cbf-4e0b-9259-471f02ba1384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:32.110875 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f5df-1cbf-4e0b-9259-471f02ba1384 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:32.111586 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f5df-1cbf-4e0b-9259-471f02ba1384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:32.111989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f5df-1cbf-4e0b-9259-471f02ba1384 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:32.112887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25f5df-1cbf-4e0b-9259-471f02ba1384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:32.114708 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25f5df-1cbf-4e0b-9259-471f02ba1384 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:32.130636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1374/2770] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:32.136741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace5ed9-2543-439c-a8e4-ca6746aa9ced admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:32.150393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace5ed9-2543-439c-a8e4-ca6746aa9ced admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:32.155789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9eed8-7633-4dc7-b66e-ff33a69f8666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:32.156886 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9eed8-7633-4dc7-b66e-ff33a69f8666 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:32.157211 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9eed8-7633-4dc7-b66e-ff33a69f8666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:32.157530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9eed8-7633-4dc7-b66e-ff33a69f8666 admin admin] PATH_INFO: `/v3/projects/f60860fc1cf74675a25424fc7c62ce17/users/bc0aaceab4e541c499d2bf5485211e6a/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:32.176352 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9eed8-7633-4dc7-b66e-ff33a69f8666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60860fc1cf74675a25424fc7c62ce17, user_id=bc0aaceab4e541c499d2bf5485211e6a, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:32.179808 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9eed8-7633-4dc7-b66e-ff33a69f8666 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:32.196561 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1397/2771] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:32 2022] PUT /identity/v3/projects/f60860fc1cf74675a25424fc7c62ce17/users/bc0aaceab4e541c499d2bf5485211e6a/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:32.201237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f5df-1cbf-4e0b-9259-471f02ba1384 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:32.218697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f5df-1cbf-4e0b-9259-471f02ba1384 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:32.298859 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2adec-dd0c-4dcc-ab60-350fa814835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:32.299757 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2adec-dd0c-4dcc-ab60-350fa814835f admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:32.299885 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2adec-dd0c-4dcc-ab60-350fa814835f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:32.300089 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2adec-dd0c-4dcc-ab60-350fa814835f admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:32.300819 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2adec-dd0c-4dcc-ab60-350fa814835f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:32.302488 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2adec-dd0c-4dcc-ab60-350fa814835f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:32.315731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1375/2772] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:32.320942 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9eed8-7633-4dc7-b66e-ff33a69f8666 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:32.342452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9eed8-7633-4dc7-b66e-ff33a69f8666 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:32.347770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe3e4-b5ea-4665-a8e2-6f0e6c1bdf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:32.348696 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe3e4-b5ea-4665-a8e2-6f0e6c1bdf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:32.348979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe3e4-b5ea-4665-a8e2-6f0e6c1bdf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:32.349256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe3e4-b5ea-4665-a8e2-6f0e6c1bdf48 admin admin] PATH_INFO: `/v3/projects/f60860fc1cf74675a25424fc7c62ce17/users/bc0aaceab4e541c499d2bf5485211e6a/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:32.351564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe3e4-b5ea-4665-a8e2-6f0e6c1bdf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60860fc1cf74675a25424fc7c62ce17, user_id=bc0aaceab4e541c499d2bf5485211e6a, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:32.354257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe3e4-b5ea-4665-a8e2-6f0e6c1bdf48 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:32.366772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1398/2773] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:32 2022] PUT /identity/v3/projects/f60860fc1cf74675a25424fc7c62ce17/users/bc0aaceab4e541c499d2bf5485211e6a/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:32.377289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9451-aea9-435d-8ff6-f4f114ff1f93 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:32.377627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9451-aea9-435d-8ff6-f4f114ff1f93 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:32.377807 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b9451-aea9-435d-8ff6-f4f114ff1f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:32.415475 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-347b9451-aea9-435d-8ff6-f4f114ff1f93 None None] MFA Rules not processed for user `bc0aaceab4e541c499d2bf5485211e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:32.416739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-347b9451-aea9-435d-8ff6-f4f114ff1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:32.435292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:32.528659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1376/2774] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:32.541097 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe3e4-b5ea-4665-a8e2-6f0e6c1bdf48 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:32.543084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-655fe3e4-b5ea-4665-a8e2-6f0e6c1bdf48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:32.622667 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe3e4-b5ea-4665-a8e2-6f0e6c1bdf48 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:32.627478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603abf61-189c-4249-9ec1-2ef30ee9754f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:32.628146 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603abf61-189c-4249-9ec1-2ef30ee9754f service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:32.628429 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603abf61-189c-4249-9ec1-2ef30ee9754f service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:32.628708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603abf61-189c-4249-9ec1-2ef30ee9754f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:32.639784 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603abf61-189c-4249-9ec1-2ef30ee9754f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:32.641307 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603abf61-189c-4249-9ec1-2ef30ee9754f service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:32.653317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1399/2775] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:34.525824 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9451-aea9-435d-8ff6-f4f114ff1f93 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:34.629995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b9451-aea9-435d-8ff6-f4f114ff1f93 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:34.635937 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:34.637007 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.637296 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.637574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] PATH_INFO: `/v3/users/85a2506bfef548dfbd3e230a80a802c3` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.638953 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a2506bfef548dfbd3e230a80a802c3)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:34.641043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:34.708457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a2506bfef548dfbd3e230a80a802c3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.710566 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a2506bfef548dfbd3e230a80a802c3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.731318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a2506bfef548dfbd3e230a80a802c3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.741457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a2506bfef548dfbd3e230a80a802c3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.752003 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a2506bfef548dfbd3e230a80a802c3'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:34.759901 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1377/2776] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:34 2022] DELETE /identity/v3/users/85a2506bfef548dfbd3e230a80a802c3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:34.767007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0f4e-ad85-490c-963f-2f60c6f625de None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:34.767793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0f4e-ad85-490c-963f-2f60c6f625de None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:34.768029 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0f4e-ad85-490c-963f-2f60c6f625de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:34.795847 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-95cb0f4e-ad85-490c-963f-2f60c6f625de None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:34.797364 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-95cb0f4e-ad85-490c-963f-2f60c6f625de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:34.892043 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1400/2777] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:34.904418 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:34.906394 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:34.962071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:35.023050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c06693-02c8-45eb-8da5-9825187432b2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:35.027689 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b18dd-a98b-4e6f-ac65-027d65553fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:35.028463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b18dd-a98b-4e6f-ac65-027d65553fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:35.028791 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b18dd-a98b-4e6f-ac65-027d65553fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:35.029115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b18dd-a98b-4e6f-ac65-027d65553fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:35.043583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b18dd-a98b-4e6f-ac65-027d65553fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:35.047229 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b18dd-a98b-4e6f-ac65-027d65553fc8 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:35.061994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1378/2778] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:35.539409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb0f4e-ad85-490c-963f-2f60c6f625de None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:35.541660 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-95cb0f4e-ad85-490c-963f-2f60c6f625de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:35.558896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:35.565779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb0f4e-ad85-490c-963f-2f60c6f625de None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:35.577717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:35.579250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:35.579746 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:35.581294 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] PATH_INFO: `/v3/projects/d21ae22b7b884feab3d6c70c7b0c6785` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:35.584570 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21ae22b7b884feab3d6c70c7b0c6785)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:35.588187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:35.671810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21ae22b7b884feab3d6c70c7b0c6785', 'request_id': 'req-b19adef5-da58-4edf-b198-353bebb6487a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.680785 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21ae22b7b884feab3d6c70c7b0c6785', 'request_id': 'req-b19adef5-da58-4edf-b198-353bebb6487a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.689073 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21ae22b7b884feab3d6c70c7b0c6785', 'request_id': 'req-b19adef5-da58-4edf-b198-353bebb6487a'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.705499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] The token cache is being invalidate because project d21ae22b7b884feab3d6c70c7b0c6785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:35.706311 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.707450 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.710359 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1401/2779] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:35 2022] DELETE /identity/v3/projects/d21ae22b7b884feab3d6c70c7b0c6785 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:35.716189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b18dd-a98b-4e6f-ac65-027d65553fc8 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:35.728963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b18dd-a98b-4e6f-ac65-027d65553fc8 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:35.806049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:35.806860 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:35.807139 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:35.807416 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] PATH_INFO: `/v3/users/bc0aaceab4e541c499d2bf5485211e6a` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:35.808717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0aaceab4e541c499d2bf5485211e6a)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:35.810890 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:35.885572 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0aaceab4e541c499d2bf5485211e6a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.886699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0aaceab4e541c499d2bf5485211e6a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.907755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0aaceab4e541c499d2bf5485211e6a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.922688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0aaceab4e541c499d2bf5485211e6a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.935441 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-c2746190-97a1-4881-9a25-1587f045ea5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0aaceab4e541c499d2bf5485211e6a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:35.943978 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1379/2780] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:35 2022] DELETE /identity/v3/users/bc0aaceab4e541c499d2bf5485211e6a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:36.324217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:36.326822 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:36.352965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19adef5-da58-4edf-b198-353bebb6487a admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:36.433392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:36.434487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.434877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.435278 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] PATH_INFO: `/v3/projects/f60860fc1cf74675a25424fc7c62ce17` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.436656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60860fc1cf74675a25424fc7c62ce17)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:36.438789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:36.503965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60860fc1cf74675a25424fc7c62ce17', 'request_id': 'req-bf0ca115-88da-42ab-aebd-cd2c701b8c38'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.514770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60860fc1cf74675a25424fc7c62ce17', 'request_id': 'req-bf0ca115-88da-42ab-aebd-cd2c701b8c38'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.521925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60860fc1cf74675a25424fc7c62ce17', 'request_id': 'req-bf0ca115-88da-42ab-aebd-cd2c701b8c38'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.534742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] The token cache is being invalidate because project f60860fc1cf74675a25424fc7c62ce17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:36.535131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.536079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-bf0ca115-88da-42ab-aebd-cd2c701b8c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:36.539340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1402/2781] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:36 2022] DELETE /identity/v3/projects/f60860fc1cf74675a25424fc7c62ce17 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:36.546189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eccfc-3973-48af-a387-7a52b912a6d1 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.546516 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eccfc-3973-48af-a387-7a52b912a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.546802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eccfc-3973-48af-a387-7a52b912a6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.571622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-260eccfc-3973-48af-a387-7a52b912a6d1 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:36.573112 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-260eccfc-3973-48af-a387-7a52b912a6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:36.647489 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:36.667692 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1380/2782] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:36.678899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ffea-7a53-4507-92c7-04fba3e0fa1e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.679403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ffea-7a53-4507-92c7-04fba3e0fa1e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.679940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ffea-7a53-4507-92c7-04fba3e0fa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.703335 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a038ffea-7a53-4507-92c7-04fba3e0fa1e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:36.705447 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a038ffea-7a53-4507-92c7-04fba3e0fa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:36.719714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1403/2783] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:36.725143 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eccfc-3973-48af-a387-7a52b912a6d1 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:36.736573 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eccfc-3973-48af-a387-7a52b912a6d1 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:36.742583 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae84d8-496a-4e7f-93e2-3682f7ed107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:36.743521 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae84d8-496a-4e7f-93e2-3682f7ed107a admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.743946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae84d8-496a-4e7f-93e2-3682f7ed107a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.744332 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae84d8-496a-4e7f-93e2-3682f7ed107a admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.745194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae84d8-496a-4e7f-93e2-3682f7ed107a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:36.745693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae84d8-496a-4e7f-93e2-3682f7ed107a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:36.747834 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae84d8-496a-4e7f-93e2-3682f7ed107a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:36.763936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1381/2784] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:05:36.768699 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038ffea-7a53-4507-92c7-04fba3e0fa1e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:36.780743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a038ffea-7a53-4507-92c7-04fba3e0fa1e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:36.786557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f123da-06da-4577-bf54-b2601917fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:36.787726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f123da-06da-4577-bf54-b2601917fdbb admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.788219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f123da-06da-4577-bf54-b2601917fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.788694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f123da-06da-4577-bf54-b2601917fdbb admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.789463 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f123da-06da-4577-bf54-b2601917fdbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:36.791557 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f123da-06da-4577-bf54-b2601917fdbb admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:36.801313 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:36.840209 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1404/2785] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:36 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:36.846809 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae84d8-496a-4e7f-93e2-3682f7ed107a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:36.864727 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae84d8-496a-4e7f-93e2-3682f7ed107a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:36.937508 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6932d-ba2e-4d4b-9439-3f016d531482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:36.938185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6932d-ba2e-4d4b-9439-3f016d531482 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.938503 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6932d-ba2e-4d4b-9439-3f016d531482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.938786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6932d-ba2e-4d4b-9439-3f016d531482 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.939801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6932d-ba2e-4d4b-9439-3f016d531482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:36.941454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6932d-ba2e-4d4b-9439-3f016d531482 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:36.969380 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1382/2786] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:36 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:36.974545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f123da-06da-4577-bf54-b2601917fdbb admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:36.987027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f123da-06da-4577-bf54-b2601917fdbb admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:36.994503 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a2cb-100c-45c5-b09e-1330dbdbb8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:36.995470 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a2cb-100c-45c5-b09e-1330dbdbb8fa admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:36.995758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a2cb-100c-45c5-b09e-1330dbdbb8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:36.996038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a2cb-100c-45c5-b09e-1330dbdbb8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:36.996789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42a2cb-100c-45c5-b09e-1330dbdbb8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:36.998445 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42a2cb-100c-45c5-b09e-1330dbdbb8fa admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.010473 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1405/2787] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:37.016075 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6932d-ba2e-4d4b-9439-3f016d531482 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.029622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6932d-ba2e-4d4b-9439-3f016d531482 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.035813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907a5f9-a9da-4cef-b0a5-55d97ded6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.036585 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907a5f9-a9da-4cef-b0a5-55d97ded6a2a admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.036969 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907a5f9-a9da-4cef-b0a5-55d97ded6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.037316 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907a5f9-a9da-4cef-b0a5-55d97ded6a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.038288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907a5f9-a9da-4cef-b0a5-55d97ded6a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.040060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907a5f9-a9da-4cef-b0a5-55d97ded6a2a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.054347 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1383/2788] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:37.059935 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a2cb-100c-45c5-b09e-1330dbdbb8fa admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.082883 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a2cb-100c-45c5-b09e-1330dbdbb8fa admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.091965 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85006aaf-93c3-40d6-b448-b0e26303effb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.093433 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85006aaf-93c3-40d6-b448-b0e26303effb admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.093950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85006aaf-93c3-40d6-b448-b0e26303effb admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.094635 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85006aaf-93c3-40d6-b448-b0e26303effb admin admin] PATH_INFO: `/v3/projects/4648fd0a43d447b2a8340642d1a4da23/users/5447605c009e4813b062674b8ba9369e/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.125504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85006aaf-93c3-40d6-b448-b0e26303effb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4648fd0a43d447b2a8340642d1a4da23, user_id=5447605c009e4813b062674b8ba9369e, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.132455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85006aaf-93c3-40d6-b448-b0e26303effb admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.153508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1406/2789] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:37 2022] PUT /identity/v3/projects/4648fd0a43d447b2a8340642d1a4da23/users/5447605c009e4813b062674b8ba9369e/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:37.165744 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf674a-c8eb-4235-a2ec-759e21e62a11 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.166088 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf674a-c8eb-4235-a2ec-759e21e62a11 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.166493 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf674a-c8eb-4235-a2ec-759e21e62a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.202696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-8bcf674a-c8eb-4235-a2ec-759e21e62a11 None None] MFA Rules not processed for user `5447605c009e4813b062674b8ba9369e`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:37.203960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8bcf674a-c8eb-4235-a2ec-759e21e62a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:37.294613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1384/2790] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:37.300064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85006aaf-93c3-40d6-b448-b0e26303effb admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.393281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85006aaf-93c3-40d6-b448-b0e26303effb admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.408832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac11ae-be13-428a-95b2-ec0c448ca35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.409156 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac11ae-be13-428a-95b2-ec0c448ca35c admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.409519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac11ae-be13-428a-95b2-ec0c448ca35c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.409855 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac11ae-be13-428a-95b2-ec0c448ca35c admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.410703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac11ae-be13-428a-95b2-ec0c448ca35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.413471 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac11ae-be13-428a-95b2-ec0c448ca35c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.456369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1407/2791] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:37 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:37.465666 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf674a-c8eb-4235-a2ec-759e21e62a11 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.480548 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf674a-c8eb-4235-a2ec-759e21e62a11 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.546801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:37.567625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e70e3-b1f0-4bcd-afcd-4f83b8d4c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.569386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e70e3-b1f0-4bcd-afcd-4f83b8d4c15b admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.569899 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e70e3-b1f0-4bcd-afcd-4f83b8d4c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.570420 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e70e3-b1f0-4bcd-afcd-4f83b8d4c15b admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.571682 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e70e3-b1f0-4bcd-afcd-4f83b8d4c15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.575434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e70e3-b1f0-4bcd-afcd-4f83b8d4c15b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.606947 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1385/2792] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:37 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:37.611607 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac11ae-be13-428a-95b2-ec0c448ca35c admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.624594 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac11ae-be13-428a-95b2-ec0c448ca35c admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.629903 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f036b3-c71b-4a62-b558-dc61ce5fdd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.630755 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f036b3-c71b-4a62-b558-dc61ce5fdd45 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.631109 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f036b3-c71b-4a62-b558-dc61ce5fdd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.631387 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f036b3-c71b-4a62-b558-dc61ce5fdd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.632136 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f036b3-c71b-4a62-b558-dc61ce5fdd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.633804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f036b3-c71b-4a62-b558-dc61ce5fdd45 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.653806 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1408/2793] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:37.659459 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e70e3-b1f0-4bcd-afcd-4f83b8d4c15b admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.678099 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e70e3-b1f0-4bcd-afcd-4f83b8d4c15b admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.684243 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3acd26-4d49-4866-a056-992b230cf7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.684972 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3acd26-4d49-4866-a056-992b230cf7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.685295 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3acd26-4d49-4866-a056-992b230cf7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.685616 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3acd26-4d49-4866-a056-992b230cf7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.686530 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3acd26-4d49-4866-a056-992b230cf7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.688257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3acd26-4d49-4866-a056-992b230cf7c1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.700593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1386/2794] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:37.705186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f036b3-c71b-4a62-b558-dc61ce5fdd45 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:37.717993 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f036b3-c71b-4a62-b558-dc61ce5fdd45 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:37.724533 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c53e5-60df-419e-b505-49ba883fbe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:37.725499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c53e5-60df-419e-b505-49ba883fbe70 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.725781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c53e5-60df-419e-b505-49ba883fbe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.726064 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c53e5-60df-419e-b505-49ba883fbe70 admin admin] PATH_INFO: `/v3/projects/42e93d4559ef4b48b34dfd0d18432f37/users/aefef252402a468790e5502242aa4765/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.744371 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c53e5-60df-419e-b505-49ba883fbe70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e93d4559ef4b48b34dfd0d18432f37, user_id=aefef252402a468790e5502242aa4765, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:37.747144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c53e5-60df-419e-b505-49ba883fbe70 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:37.766580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1409/2795] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:37 2022] PUT /identity/v3/projects/42e93d4559ef4b48b34dfd0d18432f37/users/aefef252402a468790e5502242aa4765/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:37.779944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118b05-7379-40d2-b172-77f529669034 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:37.780812 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118b05-7379-40d2-b172-77f529669034 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:37.781034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27118b05-7379-40d2-b172-77f529669034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:37.816743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-27118b05-7379-40d2-b172-77f529669034 None None] MFA Rules not processed for user `aefef252402a468790e5502242aa4765`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:37.819313 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-27118b05-7379-40d2-b172-77f529669034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:37.914221 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1387/2796] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:37.919319 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c53e5-60df-419e-b505-49ba883fbe70 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.018851 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c53e5-60df-419e-b505-49ba883fbe70 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.025201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62895-9988-4f35-804b-fbb77cc46f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.025876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62895-9988-4f35-804b-fbb77cc46f31 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.026164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62895-9988-4f35-804b-fbb77cc46f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.026478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62895-9988-4f35-804b-fbb77cc46f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.027342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d62895-9988-4f35-804b-fbb77cc46f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.029289 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d62895-9988-4f35-804b-fbb77cc46f31 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.040234 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:38.063248 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1410/2797] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:37 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:38.069374 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118b05-7379-40d2-b172-77f529669034 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.081805 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27118b05-7379-40d2-b172-77f529669034 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.167995 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c137acf-709a-45c4-84b3-5ecfe2828810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.168915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c137acf-709a-45c4-84b3-5ecfe2828810 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.169346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c137acf-709a-45c4-84b3-5ecfe2828810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.169754 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c137acf-709a-45c4-84b3-5ecfe2828810 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.170863 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c137acf-709a-45c4-84b3-5ecfe2828810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.173702 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c137acf-709a-45c4-84b3-5ecfe2828810 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.197452 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1388/2798] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:38 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:38.201615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62895-9988-4f35-804b-fbb77cc46f31 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.214096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62895-9988-4f35-804b-fbb77cc46f31 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.219212 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3767a-06a3-4ea8-8613-efb70a8ccda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.219912 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3767a-06a3-4ea8-8613-efb70a8ccda8 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.220186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3767a-06a3-4ea8-8613-efb70a8ccda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.220467 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3767a-06a3-4ea8-8613-efb70a8ccda8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.221204 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3767a-06a3-4ea8-8613-efb70a8ccda8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.222869 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3767a-06a3-4ea8-8613-efb70a8ccda8 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.235329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1411/2799] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:38.239610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c137acf-709a-45c4-84b3-5ecfe2828810 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.250897 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c137acf-709a-45c4-84b3-5ecfe2828810 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.256629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73a09-5356-4dfb-8b5b-9afee1213fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.257521 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73a09-5356-4dfb-8b5b-9afee1213fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.257798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73a09-5356-4dfb-8b5b-9afee1213fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.258073 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73a09-5356-4dfb-8b5b-9afee1213fb3 admin admin] PATH_INFO: `/v3/projects/d1f97ce1f4fd47e68b2b12d117d436af/users/ea4532de35c341f98b168bfe33f01c3e/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.275262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73a09-5356-4dfb-8b5b-9afee1213fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f97ce1f4fd47e68b2b12d117d436af, user_id=ea4532de35c341f98b168bfe33f01c3e, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.277944 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73a09-5356-4dfb-8b5b-9afee1213fb3 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.296596 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1389/2800] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:38 2022] PUT /identity/v3/projects/d1f97ce1f4fd47e68b2b12d117d436af/users/ea4532de35c341f98b168bfe33f01c3e/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:38.302046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3767a-06a3-4ea8-8613-efb70a8ccda8 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.312833 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3767a-06a3-4ea8-8613-efb70a8ccda8 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.386124 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee1bb2-5f4d-4113-a781-cc2053ea1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.386826 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee1bb2-5f4d-4113-a781-cc2053ea1240 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.387121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee1bb2-5f4d-4113-a781-cc2053ea1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.387397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee1bb2-5f4d-4113-a781-cc2053ea1240 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.388123 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee1bb2-5f4d-4113-a781-cc2053ea1240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.389717 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee1bb2-5f4d-4113-a781-cc2053ea1240 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.400331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1412/2801] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:38.404810 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73a09-5356-4dfb-8b5b-9afee1213fb3 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.417306 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73a09-5356-4dfb-8b5b-9afee1213fb3 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.425153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1ed8-de16-47ce-867f-249a6ec00de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.426675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1ed8-de16-47ce-867f-249a6ec00de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.427169 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1ed8-de16-47ce-867f-249a6ec00de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.428168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d1ed8-de16-47ce-867f-249a6ec00de1 admin admin] PATH_INFO: `/v3/projects/d1f97ce1f4fd47e68b2b12d117d436af/users/ea4532de35c341f98b168bfe33f01c3e/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.431242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d1ed8-de16-47ce-867f-249a6ec00de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f97ce1f4fd47e68b2b12d117d436af, user_id=ea4532de35c341f98b168bfe33f01c3e, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.434858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d1ed8-de16-47ce-867f-249a6ec00de1 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.452560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1390/2802] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:38 2022] PUT /identity/v3/projects/d1f97ce1f4fd47e68b2b12d117d436af/users/ea4532de35c341f98b168bfe33f01c3e/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:38.465602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9b260-2832-482f-b168-a27588c403df None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.465884 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9b260-2832-482f-b168-a27588c403df None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.466164 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9b260-2832-482f-b168-a27588c403df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.495620 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-95c9b260-2832-482f-b168-a27588c403df None None] MFA Rules not processed for user `ea4532de35c341f98b168bfe33f01c3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:38.496860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-95c9b260-2832-482f-b168-a27588c403df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:38.586537 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1413/2803] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:38.598018 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1ed8-de16-47ce-867f-249a6ec00de1 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.600245 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3a1d1ed8-de16-47ce-867f-249a6ec00de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:38.611979 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:38.677936 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d1ed8-de16-47ce-867f-249a6ec00de1 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.683952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6668-dbb9-476e-bad5-9cc5cb3a6a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.684876 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6668-dbb9-476e-bad5-9cc5cb3a6a44 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.685389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6668-dbb9-476e-bad5-9cc5cb3a6a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.685798 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6668-dbb9-476e-bad5-9cc5cb3a6a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.703925 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6668-dbb9-476e-bad5-9cc5cb3a6a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.706958 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6668-dbb9-476e-bad5-9cc5cb3a6a44 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.729478 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1391/2804] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:38.791112 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9b260-2832-482f-b168-a27588c403df None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:38.792627 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-95c9b260-2832-482f-b168-a27588c403df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:38.809138 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9b260-2832-482f-b168-a27588c403df None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:38.815222 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c1ccc-445f-403f-a1c6-87e01bd26853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:38.816264 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c1ccc-445f-403f-a1c6-87e01bd26853 service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:38.816777 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c1ccc-445f-403f-a1c6-87e01bd26853 service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:38.817221 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c1ccc-445f-403f-a1c6-87e01bd26853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:38.887227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c1ccc-445f-403f-a1c6-87e01bd26853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:38.888713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c1ccc-445f-403f-a1c6-87e01bd26853 service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:38.892779 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:38.903723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1414/2805] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:41.975067 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6668-dbb9-476e-bad5-9cc5cb3a6a44 service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:42.050082 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6668-dbb9-476e-bad5-9cc5cb3a6a44 service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:42.057233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:42.058155 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:42.058482 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:42.058768 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] PATH_INFO: `/v3/users/5447605c009e4813b062674b8ba9369e` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:42.060094 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5447605c009e4813b062674b8ba9369e)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:42.062199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:42.123999 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5447605c009e4813b062674b8ba9369e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.124627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5447605c009e4813b062674b8ba9369e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.142391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5447605c009e4813b062674b8ba9369e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.154884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5447605c009e4813b062674b8ba9369e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.163555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5447605c009e4813b062674b8ba9369e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.171109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1392/2806] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:41 2022] DELETE /identity/v3/users/5447605c009e4813b062674b8ba9369e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:42.175972 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e0086-9bc9-4145-85ca-55bd6e9da7c8 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:42.176478 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e0086-9bc9-4145-85ca-55bd6e9da7c8 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:42.176584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e0086-9bc9-4145-85ca-55bd6e9da7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:42.196336 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-a58e0086-9bc9-4145-85ca-55bd6e9da7c8 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:42.197726 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a58e0086-9bc9-4145-85ca-55bd6e9da7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:42.270871 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1415/2807] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:42.282633 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:42.284153 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:42.324983 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:42.361445 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3f5e8-49b2-4409-8853-018796107b9c admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:42.366400 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70323804-71e1-4d3e-b571-87f3fbe69147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:42.367109 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70323804-71e1-4d3e-b571-87f3fbe69147 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:42.367421 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70323804-71e1-4d3e-b571-87f3fbe69147 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:42.367699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70323804-71e1-4d3e-b571-87f3fbe69147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:42.378439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70323804-71e1-4d3e-b571-87f3fbe69147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:42.379956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70323804-71e1-4d3e-b571-87f3fbe69147 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:42.391930 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1393/2808] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:42.702955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e0086-9bc9-4145-85ca-55bd6e9da7c8 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:42.705366 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a58e0086-9bc9-4145-85ca-55bd6e9da7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:42.727475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e0086-9bc9-4145-85ca-55bd6e9da7c8 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:42.734581 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:42.735714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:42.736127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:42.736849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] PATH_INFO: `/v3/projects/4648fd0a43d447b2a8340642d1a4da23` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:42.739954 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4648fd0a43d447b2a8340642d1a4da23)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:42.744092 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:42.809974 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4648fd0a43d447b2a8340642d1a4da23', 'request_id': 'req-d9bc6171-9264-4444-9949-eddb891d49d5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.822512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4648fd0a43d447b2a8340642d1a4da23', 'request_id': 'req-d9bc6171-9264-4444-9949-eddb891d49d5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.834737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4648fd0a43d447b2a8340642d1a4da23', 'request_id': 'req-d9bc6171-9264-4444-9949-eddb891d49d5'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.847134 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] The token cache is being invalidate because project 4648fd0a43d447b2a8340642d1a4da23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:42.847439 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.848233 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:42.850121 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1416/2809] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:42 2022] DELETE /identity/v3/projects/4648fd0a43d447b2a8340642d1a4da23 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:42.854308 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70323804-71e1-4d3e-b571-87f3fbe69147 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:42.875110 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70323804-71e1-4d3e-b571-87f3fbe69147 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:42.942574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:42.943974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:42.944263 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:42.944547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] PATH_INFO: `/v3/users/aefef252402a468790e5502242aa4765` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:42.945865 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefef252402a468790e5502242aa4765)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:42.947851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:43.004392 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefef252402a468790e5502242aa4765'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.005253 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefef252402a468790e5502242aa4765'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.021654 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefef252402a468790e5502242aa4765'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.029946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefef252402a468790e5502242aa4765'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.038709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefef252402a468790e5502242aa4765'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.046104 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1394/2810] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:42 2022] DELETE /identity/v3/users/aefef252402a468790e5502242aa4765 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:43.411789 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:43.413904 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:43.432131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc6171-9264-4444-9949-eddb891d49d5 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:43.513889 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:43.515317 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:43.515796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:43.516293 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] PATH_INFO: `/v3/projects/42e93d4559ef4b48b34dfd0d18432f37` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:43.518513 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e93d4559ef4b48b34dfd0d18432f37)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:43.522682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:43.566564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:43.597669 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e93d4559ef4b48b34dfd0d18432f37', 'request_id': 'req-6ebba40d-d911-4bd4-aa6d-0126eedd8257'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.610839 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e93d4559ef4b48b34dfd0d18432f37', 'request_id': 'req-6ebba40d-d911-4bd4-aa6d-0126eedd8257'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.620621 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e93d4559ef4b48b34dfd0d18432f37', 'request_id': 'req-6ebba40d-d911-4bd4-aa6d-0126eedd8257'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.635200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] The token cache is being invalidate because project 42e93d4559ef4b48b34dfd0d18432f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:43.635547 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.636291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.638345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1417/2811] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:43 2022] DELETE /identity/v3/projects/42e93d4559ef4b48b34dfd0d18432f37 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:43.643696 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:43.645185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:43.661015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e2986-3b35-42c2-b54b-48595c39ec90 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:43.728743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:43.739540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:43.741675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:43.741968 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:43.742257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] PATH_INFO: `/v3/users/ea4532de35c341f98b168bfe33f01c3e` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:43.743804 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4532de35c341f98b168bfe33f01c3e)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:43.745981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:43.838541 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4532de35c341f98b168bfe33f01c3e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.839609 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4532de35c341f98b168bfe33f01c3e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.861994 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4532de35c341f98b168bfe33f01c3e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.874945 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4532de35c341f98b168bfe33f01c3e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.885797 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-76730f1a-a2a7-40fb-b5a8-bc2e9a8d8876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4532de35c341f98b168bfe33f01c3e'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:43.897888 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1395/2812] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:43 2022] DELETE /identity/v3/users/ea4532de35c341f98b168bfe33f01c3e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:44.279793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:44.282063 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:44.302182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebba40d-d911-4bd4-aa6d-0126eedd8257 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:44.404778 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:44.405776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.406071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.406386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] PATH_INFO: `/v3/projects/d1f97ce1f4fd47e68b2b12d117d436af` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.408273 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f97ce1f4fd47e68b2b12d117d436af)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:44.411841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:44.491494 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f97ce1f4fd47e68b2b12d117d436af', 'request_id': 'req-a5c455b4-bc40-4d33-880e-864d2687fc30'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.501907 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f97ce1f4fd47e68b2b12d117d436af', 'request_id': 'req-a5c455b4-bc40-4d33-880e-864d2687fc30'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.509723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f97ce1f4fd47e68b2b12d117d436af', 'request_id': 'req-a5c455b4-bc40-4d33-880e-864d2687fc30'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.521925 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] The token cache is being invalidate because project d1f97ce1f4fd47e68b2b12d117d436af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:44.522419 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.523339 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-a5c455b4-bc40-4d33-880e-864d2687fc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:44.524932 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1418/2813] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:44 2022] DELETE /identity/v3/projects/d1f97ce1f4fd47e68b2b12d117d436af => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:44.531242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b157e4-639d-4b0a-92a2-01fcc948f1aa None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.531793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b157e4-639d-4b0a-92a2-01fcc948f1aa None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.531793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b157e4-639d-4b0a-92a2-01fcc948f1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.557222 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-e7b157e4-639d-4b0a-92a2-01fcc948f1aa None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:44.558568 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e7b157e4-639d-4b0a-92a2-01fcc948f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:44.649531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1396/2814] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:44.659253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6112-468f-4ddc-9688-a133fb290b8b None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.659770 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6112-468f-4ddc-9688-a133fb290b8b None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.660257 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6112-468f-4ddc-9688-a133fb290b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.689504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-360a6112-468f-4ddc-9688-a133fb290b8b None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:44.691741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-360a6112-468f-4ddc-9688-a133fb290b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:44.703500 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1419/2815] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:44.708458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b157e4-639d-4b0a-92a2-01fcc948f1aa None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:44.719975 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b157e4-639d-4b0a-92a2-01fcc948f1aa None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:44.726361 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cab6ea-fc29-476c-8c47-0f8febe3b0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:44.727071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cab6ea-fc29-476c-8c47-0f8febe3b0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.727354 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cab6ea-fc29-476c-8c47-0f8febe3b0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.727636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cab6ea-fc29-476c-8c47-0f8febe3b0b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.728407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cab6ea-fc29-476c-8c47-0f8febe3b0b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:44.728719 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cab6ea-fc29-476c-8c47-0f8febe3b0b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:44.730645 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cab6ea-fc29-476c-8c47-0f8febe3b0b8 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:44.745820 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1397/2816] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:44.751584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a6112-468f-4ddc-9688-a133fb290b8b None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:44.769145 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a6112-468f-4ddc-9688-a133fb290b8b None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:44.776880 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedbf4d-551a-4c4c-9527-f54db79901e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:44.777918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedbf4d-551a-4c4c-9527-f54db79901e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.778477 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedbf4d-551a-4c4c-9527-f54db79901e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.778964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedbf4d-551a-4c4c-9527-f54db79901e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.780187 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedbf4d-551a-4c4c-9527-f54db79901e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:44.783704 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedbf4d-551a-4c4c-9527-f54db79901e9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:44.814404 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1420/2817] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:44 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:44.820423 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cab6ea-fc29-476c-8c47-0f8febe3b0b8 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:44.831912 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cab6ea-fc29-476c-8c47-0f8febe3b0b8 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:44.907629 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98388c-6fcb-4ea7-981a-5ed5899c755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:44.908363 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98388c-6fcb-4ea7-981a-5ed5899c755e admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.908644 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98388c-6fcb-4ea7-981a-5ed5899c755e admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.908923 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98388c-6fcb-4ea7-981a-5ed5899c755e admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.909651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98388c-6fcb-4ea7-981a-5ed5899c755e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:44.911662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98388c-6fcb-4ea7-981a-5ed5899c755e admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:44.919662 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:44.938484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1398/2818] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:44 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:44.943384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedbf4d-551a-4c4c-9527-f54db79901e9 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:44.954742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedbf4d-551a-4c4c-9527-f54db79901e9 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:44.961788 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89e8f-7c4f-41ca-85f7-df1833a2776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:44.962545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89e8f-7c4f-41ca-85f7-df1833a2776d admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:44.962939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89e8f-7c4f-41ca-85f7-df1833a2776d admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:44.963166 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89e8f-7c4f-41ca-85f7-df1833a2776d admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:44.963850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab89e8f-7c4f-41ca-85f7-df1833a2776d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:44.965508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab89e8f-7c4f-41ca-85f7-df1833a2776d admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:44.980901 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1421/2819] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:44.985540 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98388c-6fcb-4ea7-981a-5ed5899c755e admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:44.996683 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98388c-6fcb-4ea7-981a-5ed5899c755e admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.001608 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793a81b-5fe3-499d-bd06-9ff07284832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.002204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793a81b-5fe3-499d-bd06-9ff07284832c admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.003274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793a81b-5fe3-499d-bd06-9ff07284832c admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.003274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793a81b-5fe3-499d-bd06-9ff07284832c admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.003736 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793a81b-5fe3-499d-bd06-9ff07284832c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.005211 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793a81b-5fe3-499d-bd06-9ff07284832c admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:45.017547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1399/2820] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:45.023365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89e8f-7c4f-41ca-85f7-df1833a2776d admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.031318 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:45.039115 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89e8f-7c4f-41ca-85f7-df1833a2776d admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.045741 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc4033-bc13-44c3-a654-a054df74a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.046872 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc4033-bc13-44c3-a654-a054df74a649 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.047160 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc4033-bc13-44c3-a654-a054df74a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.047442 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc4033-bc13-44c3-a654-a054df74a649 admin admin] PATH_INFO: `/v3/projects/6fe9aed84428410594d971a38c7008cc/users/ce01763e4e7e40b69dd1dd868f1cd0b8/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.065913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc4033-bc13-44c3-a654-a054df74a649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe9aed84428410594d971a38c7008cc, user_id=ce01763e4e7e40b69dd1dd868f1cd0b8, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.068968 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc4033-bc13-44c3-a654-a054df74a649 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:45.094141 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1422/2821] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:45 2022] PUT /identity/v3/projects/6fe9aed84428410594d971a38c7008cc/users/ce01763e4e7e40b69dd1dd868f1cd0b8/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:45.111071 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6520-fc0f-407c-8234-109fb5684941 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.111499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6520-fc0f-407c-8234-109fb5684941 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.111880 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba6520-fc0f-407c-8234-109fb5684941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.145590 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-a2ba6520-fc0f-407c-8234-109fb5684941 None None] MFA Rules not processed for user `ce01763e4e7e40b69dd1dd868f1cd0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:45.147471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a2ba6520-fc0f-407c-8234-109fb5684941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:45.234060 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1400/2822] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:45.240553 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc4033-bc13-44c3-a654-a054df74a649 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.324659 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc4033-bc13-44c3-a654-a054df74a649 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.330227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1274-98e1-4c1d-83fc-81716adf6a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.330983 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1274-98e1-4c1d-83fc-81716adf6a21 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.331532 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1274-98e1-4c1d-83fc-81716adf6a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.331810 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1274-98e1-4c1d-83fc-81716adf6a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.332548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1274-98e1-4c1d-83fc-81716adf6a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.335280 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1274-98e1-4c1d-83fc-81716adf6a21 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:45.377499 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1423/2823] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:45 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:45.384922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6520-fc0f-407c-8234-109fb5684941 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.400223 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba6520-fc0f-407c-8234-109fb5684941 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.482069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f1e8d-fb2e-4607-a6df-ebb672a7cdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.482800 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f1e8d-fb2e-4607-a6df-ebb672a7cdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.483186 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f1e8d-fb2e-4607-a6df-ebb672a7cdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.483392 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f1e8d-fb2e-4607-a6df-ebb672a7cdd8 admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.484212 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f1e8d-fb2e-4607-a6df-ebb672a7cdd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.486199 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f1e8d-fb2e-4607-a6df-ebb672a7cdd8 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:45.523747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1401/2824] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:45 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:45.525865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1274-98e1-4c1d-83fc-81716adf6a21 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.545357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1274-98e1-4c1d-83fc-81716adf6a21 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.554646 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84360-2b31-4a16-b920-b4e02c8faa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.555602 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84360-2b31-4a16-b920-b4e02c8faa1e admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.555964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84360-2b31-4a16-b920-b4e02c8faa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.556262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84360-2b31-4a16-b920-b4e02c8faa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.557038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d84360-2b31-4a16-b920-b4e02c8faa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.558940 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d84360-2b31-4a16-b920-b4e02c8faa1e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:45.575599 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1424/2825] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:45.581690 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f1e8d-fb2e-4607-a6df-ebb672a7cdd8 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.600711 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f1e8d-fb2e-4607-a6df-ebb672a7cdd8 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.609021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde0e39-becf-459f-97ea-ace21a548dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.609898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0e39-becf-459f-97ea-ace21a548dcf admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.610185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0e39-becf-459f-97ea-ace21a548dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.610560 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde0e39-becf-459f-97ea-ace21a548dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.611527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde0e39-becf-459f-97ea-ace21a548dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.613898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde0e39-becf-459f-97ea-ace21a548dcf admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:45.634615 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1402/2826] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:45.641541 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84360-2b31-4a16-b920-b4e02c8faa1e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.654508 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84360-2b31-4a16-b920-b4e02c8faa1e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.659900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b030d5-a789-42cb-8ec8-b9ace8dfad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.660835 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b030d5-a789-42cb-8ec8-b9ace8dfad47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.661127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b030d5-a789-42cb-8ec8-b9ace8dfad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.661409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b030d5-a789-42cb-8ec8-b9ace8dfad47 admin admin] PATH_INFO: `/v3/projects/1504e205ce5c4cbf83a90ba2f362a62e/users/2b56011faa2a44e09c5d729290242261/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.681242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b030d5-a789-42cb-8ec8-b9ace8dfad47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1504e205ce5c4cbf83a90ba2f362a62e, user_id=2b56011faa2a44e09c5d729290242261, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:45.684013 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b030d5-a789-42cb-8ec8-b9ace8dfad47 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:45.704988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1425/2827] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:45 2022] PUT /identity/v3/projects/1504e205ce5c4cbf83a90ba2f362a62e/users/2b56011faa2a44e09c5d729290242261/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:05:45.724230 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464df5-3fe6-49e0-b7a3-365d8e7e6848 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.724622 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464df5-3fe6-49e0-b7a3-365d8e7e6848 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.724927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464df5-3fe6-49e0-b7a3-365d8e7e6848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.758217 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-32464df5-3fe6-49e0-b7a3-365d8e7e6848 None None] MFA Rules not processed for user `2b56011faa2a44e09c5d729290242261`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:45.759877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-32464df5-3fe6-49e0-b7a3-365d8e7e6848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:45.812235 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:45.869895 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1403/2828] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:45.876677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b030d5-a789-42cb-8ec8-b9ace8dfad47 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:45.989969 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b030d5-a789-42cb-8ec8-b9ace8dfad47 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:45.995612 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f038da-cc97-43c4-a929-a4b20871a638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:45.996378 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f038da-cc97-43c4-a929-a4b20871a638 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:45.996708 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f038da-cc97-43c4-a929-a4b20871a638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:45.997153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f038da-cc97-43c4-a929-a4b20871a638 admin admin] PATH_INFO: `/v3/projects` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:45.997852 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f038da-cc97-43c4-a929-a4b20871a638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.000084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f038da-cc97-43c4-a929-a4b20871a638 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.034545 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1426/2829] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:45 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:46.035613 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464df5-3fe6-49e0-b7a3-365d8e7e6848 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.048429 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464df5-3fe6-49e0-b7a3-365d8e7e6848 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.113671 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e3d1-b881-4ff6-a4cd-19bdd067cebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.114391 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e3d1-b881-4ff6-a4cd-19bdd067cebe admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.114681 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e3d1-b881-4ff6-a4cd-19bdd067cebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.115625 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74e3d1-b881-4ff6-a4cd-19bdd067cebe admin admin] PATH_INFO: `/v3/users` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.116646 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74e3d1-b881-4ff6-a4cd-19bdd067cebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.118648 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74e3d1-b881-4ff6-a4cd-19bdd067cebe admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.141091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1404/2830] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:46 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:05:46.144296 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f038da-cc97-43c4-a929-a4b20871a638 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.155860 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f038da-cc97-43c4-a929-a4b20871a638 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.160859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6b08d-7ffb-49d6-ace7-8b1111c70771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.162593 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6b08d-7ffb-49d6-ace7-8b1111c70771 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.162894 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6b08d-7ffb-49d6-ace7-8b1111c70771 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.163323 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6b08d-7ffb-49d6-ace7-8b1111c70771 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.164066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6b08d-7ffb-49d6-ace7-8b1111c70771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.168372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6b08d-7ffb-49d6-ace7-8b1111c70771 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.181086 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1427/2831] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:46.188817 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e3d1-b881-4ff6-a4cd-19bdd067cebe admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.201146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74e3d1-b881-4ff6-a4cd-19bdd067cebe admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.208471 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318b9f6-c391-4fc6-b3d4-06d63e2b5193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.209911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318b9f6-c391-4fc6-b3d4-06d63e2b5193 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.210346 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318b9f6-c391-4fc6-b3d4-06d63e2b5193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.210697 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318b9f6-c391-4fc6-b3d4-06d63e2b5193 admin admin] PATH_INFO: `/v3/projects/718cd0a587be4cc782208a7aa1e8c56b/users/1138a380dde84770a300d611274c877e/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.232148 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318b9f6-c391-4fc6-b3d4-06d63e2b5193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718cd0a587be4cc782208a7aa1e8c56b, user_id=1138a380dde84770a300d611274c877e, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.235091 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318b9f6-c391-4fc6-b3d4-06d63e2b5193 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.262632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1405/2832] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:46 2022] PUT /identity/v3/projects/718cd0a587be4cc782208a7aa1e8c56b/users/1138a380dde84770a300d611274c877e/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:46.268242 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6b08d-7ffb-49d6-ace7-8b1111c70771 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.277180 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:46.289584 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6b08d-7ffb-49d6-ace7-8b1111c70771 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.355340 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de14d51-c91e-45ee-81b5-59340b479c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.356044 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14d51-c91e-45ee-81b5-59340b479c35 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.356329 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14d51-c91e-45ee-81b5-59340b479c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.356611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14d51-c91e-45ee-81b5-59340b479c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.357362 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de14d51-c91e-45ee-81b5-59340b479c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.359055 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de14d51-c91e-45ee-81b5-59340b479c35 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.371095 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1428/2833] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:05:46.381922 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318b9f6-c391-4fc6-b3d4-06d63e2b5193 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.387934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318b9f6-c391-4fc6-b3d4-06d63e2b5193 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.394146 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf9296-1f8e-4c2b-b915-ef262bc5f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.395030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf9296-1f8e-4c2b-b915-ef262bc5f084 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.395399 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf9296-1f8e-4c2b-b915-ef262bc5f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.395679 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf9296-1f8e-4c2b-b915-ef262bc5f084 admin admin] PATH_INFO: `/v3/projects/718cd0a587be4cc782208a7aa1e8c56b/users/1138a380dde84770a300d611274c877e/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.399285 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf9296-1f8e-4c2b-b915-ef262bc5f084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=718cd0a587be4cc782208a7aa1e8c56b, user_id=1138a380dde84770a300d611274c877e, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.402647 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf9296-1f8e-4c2b-b915-ef262bc5f084 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.416187 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1406/2834] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:46 2022] PUT /identity/v3/projects/718cd0a587be4cc782208a7aa1e8c56b/users/1138a380dde84770a300d611274c877e/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:46.428149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d6c4-a184-4182-9393-7a08aa1e5da2 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.428431 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d6c4-a184-4182-9393-7a08aa1e5da2 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.428680 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d6c4-a184-4182-9393-7a08aa1e5da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.469198 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-4ac3d6c4-a184-4182-9393-7a08aa1e5da2 None None] MFA Rules not processed for user `1138a380dde84770a300d611274c877e`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:46.471368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4ac3d6c4-a184-4182-9393-7a08aa1e5da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:46.578820 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1429/2835] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:46.598180 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf9296-1f8e-4c2b-b915-ef262bc5f084 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:46.601674 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-edbf9296-1f8e-4c2b-b915-ef262bc5f084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:46.683945 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf9296-1f8e-4c2b-b915-ef262bc5f084 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:46.687743 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccf563-aa7d-4545-a06b-68b93385490d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:46.688412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf563-aa7d-4545-a06b-68b93385490d service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:46.688877 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf563-aa7d-4545-a06b-68b93385490d service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:46.689336 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccf563-aa7d-4545-a06b-68b93385490d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:46.744792 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:46.779793 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccf563-aa7d-4545-a06b-68b93385490d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:46.782272 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccf563-aa7d-4545-a06b-68b93385490d service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:46.799348 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1407/2836] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:48.445745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3d6c4-a184-4182-9393-7a08aa1e5da2 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:48.447269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4ac3d6c4-a184-4182-9393-7a08aa1e5da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:48.461566 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3d6c4-a184-4182-9393-7a08aa1e5da2 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:48.465262 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282f2c4-9fbf-433e-8607-d6673e541fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:48.465922 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282f2c4-9fbf-433e-8607-d6673e541fac service cinder] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:48.466213 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282f2c4-9fbf-433e-8607-d6673e541fac service cinder] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:48.466529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282f2c4-9fbf-433e-8607-d6673e541fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:48.541565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282f2c4-9fbf-433e-8607-d6673e541fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:48.543908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282f2c4-9fbf-433e-8607-d6673e541fac service cinder] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:48.555497 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1430/2837] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:49.241491 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccf563-aa7d-4545-a06b-68b93385490d service cinder] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:49.250192 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccf563-aa7d-4545-a06b-68b93385490d service cinder] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:49.254549 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4514232-4371-46db-ab25-b7833569a688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:49.256065 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514232-4371-46db-ab25-b7833569a688 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:49.256390 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514232-4371-46db-ab25-b7833569a688 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:49.256832 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4514232-4371-46db-ab25-b7833569a688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:49.268769 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4514232-4371-46db-ab25-b7833569a688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:49.270486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4514232-4371-46db-ab25-b7833569a688 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:49.281985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1408/2838] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:05:53.324426 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282f2c4-9fbf-433e-8607-d6673e541fac service cinder] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:53.356394 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=100 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:53.414087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282f2c4-9fbf-433e-8607-d6673e541fac service cinder] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:53.419027 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:53.419921 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:53.420208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:53.420489 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] PATH_INFO: `/v3/users/ce01763e4e7e40b69dd1dd868f1cd0b8` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:53.421749 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce01763e4e7e40b69dd1dd868f1cd0b8)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:53.423737 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:53.484849 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce01763e4e7e40b69dd1dd868f1cd0b8'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:53.485531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce01763e4e7e40b69dd1dd868f1cd0b8'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:53.486149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce01763e4e7e40b69dd1dd868f1cd0b8'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:53.500730 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce01763e4e7e40b69dd1dd868f1cd0b8'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:53.510165 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce01763e4e7e40b69dd1dd868f1cd0b8'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:53.527370 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1431/2839] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:53 2022] DELETE /identity/v3/users/ce01763e4e7e40b69dd1dd868f1cd0b8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:53.532127 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2dd6c-2079-41c5-8eb5-f6a241d0ae85 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:53.532707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2dd6c-2079-41c5-8eb5-f6a241d0ae85 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:53.532707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2dd6c-2079-41c5-8eb5-f6a241d0ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:53.555292 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-3af2dd6c-2079-41c5-8eb5-f6a241d0ae85 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:53.556536 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3af2dd6c-2079-41c5-8eb5-f6a241d0ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:53.651627 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1409/2840] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:53.664357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:53.666303 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:53.735393 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79c560-a52c-4a83-95a4-617fd6dd2e5f admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:53.739589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a70069-b991-4efb-957e-6fa6239da241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:53.740456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a70069-b991-4efb-957e-6fa6239da241 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:53.740945 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a70069-b991-4efb-957e-6fa6239da241 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:53.741332 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a70069-b991-4efb-957e-6fa6239da241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:53.752796 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a70069-b991-4efb-957e-6fa6239da241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:53.754151 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a70069-b991-4efb-957e-6fa6239da241 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:53.765656 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1432/2841] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:54.086981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2dd6c-2079-41c5-8eb5-f6a241d0ae85 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:54.088632 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-3af2dd6c-2079-41c5-8eb5-f6a241d0ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:54.103595 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2dd6c-2079-41c5-8eb5-f6a241d0ae85 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:54.109257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:54.110770 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:54.111214 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:54.111634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] PATH_INFO: `/v3/projects/6fe9aed84428410594d971a38c7008cc` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:54.113288 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe9aed84428410594d971a38c7008cc)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:54.116383 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:54.186300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe9aed84428410594d971a38c7008cc', 'request_id': 'req-eed09f0f-40ae-47ce-959d-c32752275a1a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.203063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe9aed84428410594d971a38c7008cc', 'request_id': 'req-eed09f0f-40ae-47ce-959d-c32752275a1a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.211034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe9aed84428410594d971a38c7008cc', 'request_id': 'req-eed09f0f-40ae-47ce-959d-c32752275a1a'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.223737 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] The token cache is being invalidate because project 6fe9aed84428410594d971a38c7008cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:54.224087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.225434 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.227087 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1410/2842] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:54 2022] DELETE /identity/v3/projects/6fe9aed84428410594d971a38c7008cc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:54.235060 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a70069-b991-4efb-957e-6fa6239da241 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:54.252403 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a70069-b991-4efb-957e-6fa6239da241 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:54.301345 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:54.323342 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:54.324232 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:54.324517 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:54.325354 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] PATH_INFO: `/v3/users/2b56011faa2a44e09c5d729290242261` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:54.326491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b56011faa2a44e09c5d729290242261)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:54.329841 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:54.403688 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b56011faa2a44e09c5d729290242261'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.404719 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b56011faa2a44e09c5d729290242261'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.405793 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b56011faa2a44e09c5d729290242261'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.421899 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b56011faa2a44e09c5d729290242261'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.429523 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b56011faa2a44e09c5d729290242261'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:54.444758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1433/2843] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:54 2022] DELETE /identity/v3/users/2b56011faa2a44e09c5d729290242261 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:54.816830 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:54.819623 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:54.834725 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed09f0f-40ae-47ce-959d-c32752275a1a admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:54.912843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:54.926100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:54.926935 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:54.928614 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:54.929484 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] PATH_INFO: `/v3/projects/1504e205ce5c4cbf83a90ba2f362a62e` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:54.932064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1504e205ce5c4cbf83a90ba2f362a62e)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:54.935652 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:55.010177 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1504e205ce5c4cbf83a90ba2f362a62e', 'request_id': 'req-03304020-6237-489b-bfee-7674c69d1001'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.021185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1504e205ce5c4cbf83a90ba2f362a62e', 'request_id': 'req-03304020-6237-489b-bfee-7674c69d1001'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.030740 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1504e205ce5c4cbf83a90ba2f362a62e', 'request_id': 'req-03304020-6237-489b-bfee-7674c69d1001'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.046699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] The token cache is being invalidate because project 1504e205ce5c4cbf83a90ba2f362a62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:55.047157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.047986 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.050284 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1411/2844] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:54 2022] DELETE /identity/v3/projects/1504e205ce5c4cbf83a90ba2f362a62e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:55.056812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:55.058682 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:55.078105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ee2dc-5062-4f53-aab2-12484c4788f7 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:55.159186 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:55.159973 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:55.160258 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:55.160540 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] PATH_INFO: `/v3/users/1138a380dde84770a300d611274c877e` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:55.162668 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1138a380dde84770a300d611274c877e)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:55.164606 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:55.221217 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1138a380dde84770a300d611274c877e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.221905 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1138a380dde84770a300d611274c877e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.222571 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1138a380dde84770a300d611274c877e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.238962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1138a380dde84770a300d611274c877e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.241388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:55.252524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-ea393d88-162c-479c-aaf2-faff8364cb7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1138a380dde84770a300d611274c877e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.276964 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1434/2845] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:05:55 2022] DELETE /identity/v3/users/1138a380dde84770a300d611274c877e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:55.631142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:55.632778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:55.648813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03304020-6237-489b-bfee-7674c69d1001 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:55.718988 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:55.719760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:55.720037 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:55.720318 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] PATH_INFO: `/v3/projects/718cd0a587be4cc782208a7aa1e8c56b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:55.721563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=718cd0a587be4cc782208a7aa1e8c56b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:55.723511 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:55.774974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '718cd0a587be4cc782208a7aa1e8c56b', 'request_id': 'req-0b74fe7e-d83a-429c-8569-0ec93839aa70'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.783760 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '718cd0a587be4cc782208a7aa1e8c56b', 'request_id': 'req-0b74fe7e-d83a-429c-8569-0ec93839aa70'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.791547 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '718cd0a587be4cc782208a7aa1e8c56b', 'request_id': 'req-0b74fe7e-d83a-429c-8569-0ec93839aa70'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.803289 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] The token cache is being invalidate because project 718cd0a587be4cc782208a7aa1e8c56b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:05:55.803582 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.804264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-0b74fe7e-d83a-429c-8569-0ec93839aa70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:05:55.805846 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1412/2846] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:05:55 2022] DELETE /identity/v3/projects/718cd0a587be4cc782208a7aa1e8c56b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:55.811017 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e8c1-9ba1-4b03-b638-d2f4f6ce2903 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:55.811580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e8c1-9ba1-4b03-b638-d2f4f6ce2903 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:55.811580 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e8c1-9ba1-4b03-b638-d2f4f6ce2903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:55.831563 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-fad7e8c1-9ba1-4b03-b638-d2f4f6ce2903 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:55.832800 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-fad7e8c1-9ba1-4b03-b638-d2f4f6ce2903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:55.900893 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1435/2847] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:55.965851 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af91a20-10a3-4ae2-b4c1-26ff7df1d87d None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:55.966497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af91a20-10a3-4ae2-b4c1-26ff7df1d87d None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:55.966497 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af91a20-10a3-4ae2-b4c1-26ff7df1d87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:55.986393 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-2af91a20-10a3-4ae2-b4c1-26ff7df1d87d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:55.987550 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2af91a20-10a3-4ae2-b4c1-26ff7df1d87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:55.995977 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1413/2848] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:05:56.000361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7e8c1-9ba1-4b03-b638-d2f4f6ce2903 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:56.011105 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7e8c1-9ba1-4b03-b638-d2f4f6ce2903 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:56.015842 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1c105-46b0-40c5-a4dd-28a1fb1575a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:56.016512 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c105-46b0-40c5-a4dd-28a1fb1575a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:56.016803 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c105-46b0-40c5-a4dd-28a1fb1575a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:56.017087 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1c105-46b0-40c5-a4dd-28a1fb1575a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:56.017832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1c105-46b0-40c5-a4dd-28a1fb1575a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:05:56.018150 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1c105-46b0-40c5-a4dd-28a1fb1575a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:56.019805 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1c105-46b0-40c5-a4dd-28a1fb1575a1 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:56.034111 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1436/2849] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:05:56.039799 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af91a20-10a3-4ae2-b4c1-26ff7df1d87d None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:56.049531 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af91a20-10a3-4ae2-b4c1-26ff7df1d87d None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:56.055220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7397323-e2ff-462c-9071-75a30b180546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:56.055887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7397323-e2ff-462c-9071-75a30b180546 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:56.056172 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7397323-e2ff-462c-9071-75a30b180546 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:56.056456 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7397323-e2ff-462c-9071-75a30b180546 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:56.057164 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7397323-e2ff-462c-9071-75a30b180546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:56.059145 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7397323-e2ff-462c-9071-75a30b180546 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:56.062693 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:56.095957 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1414/2850] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:05:56 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:56.097110 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1c105-46b0-40c5-a4dd-28a1fb1575a1 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:56.107900 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1c105-46b0-40c5-a4dd-28a1fb1575a1 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:56.172223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cc834-a931-4a97-866b-c5ee250af74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:56.172931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cc834-a931-4a97-866b-c5ee250af74e admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:56.173218 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cc834-a931-4a97-866b-c5ee250af74e admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:56.173524 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146cc834-a931-4a97-866b-c5ee250af74e admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:56.174269 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cc834-a931-4a97-866b-c5ee250af74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:56.176268 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146cc834-a931-4a97-866b-c5ee250af74e admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:56.202068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1437/2851] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:05:56 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:05:56.206949 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7397323-e2ff-462c-9071-75a30b180546 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:56.221450 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7397323-e2ff-462c-9071-75a30b180546 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:56.227194 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c05b7-13e5-42c5-9b8c-58269d33a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:56.227894 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c05b7-13e5-42c5-9b8c-58269d33a522 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:56.228178 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c05b7-13e5-42c5-9b8c-58269d33a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:56.228457 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c05b7-13e5-42c5-9b8c-58269d33a522 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:56.229191 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c05b7-13e5-42c5-9b8c-58269d33a522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:56.230843 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c05b7-13e5-42c5-9b8c-58269d33a522 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:56.242401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1415/2852] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:56.246530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cc834-a931-4a97-866b-c5ee250af74e admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:56.257723 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146cc834-a931-4a97-866b-c5ee250af74e admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:56.262824 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbc302-2dfc-43ea-9444-6b0ca086e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:56.263493 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbc302-2dfc-43ea-9444-6b0ca086e0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:56.264815 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbc302-2dfc-43ea-9444-6b0ca086e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:56.265096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbc302-2dfc-43ea-9444-6b0ca086e0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:56.265823 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbc302-2dfc-43ea-9444-6b0ca086e0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:56.267487 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbc302-2dfc-43ea-9444-6b0ca086e0f7 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:56.280306 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1438/2853] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:05:56.285147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c05b7-13e5-42c5-9b8c-58269d33a522 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:56.296203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c05b7-13e5-42c5-9b8c-58269d33a522 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:56.301734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c66546-a325-4b56-9064-dfa4d78470d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:56.303201 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c66546-a325-4b56-9064-dfa4d78470d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:56.303634 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c66546-a325-4b56-9064-dfa4d78470d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:56.303919 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c66546-a325-4b56-9064-dfa4d78470d2 admin admin] PATH_INFO: `/v3/projects/8b51a9b11a6e4069aa79b85ccb5408ac/users/d5383a86a7b34c1dad0e14b3d1971ba6/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:56.320775 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c66546-a325-4b56-9064-dfa4d78470d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b51a9b11a6e4069aa79b85ccb5408ac, user_id=d5383a86a7b34c1dad0e14b3d1971ba6, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:56.323658 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c66546-a325-4b56-9064-dfa4d78470d2 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:56.339659 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1416/2854] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:05:56 2022] PUT /identity/v3/projects/8b51a9b11a6e4069aa79b85ccb5408ac/users/d5383a86a7b34c1dad0e14b3d1971ba6/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:05:56.351129 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa345be-4e49-438e-82ec-58ce2ae7b574 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:56.351572 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa345be-4e49-438e-82ec-58ce2ae7b574 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:56.352007 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa345be-4e49-438e-82ec-58ce2ae7b574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:56.382400 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-bfa345be-4e49-438e-82ec-58ce2ae7b574 None None] MFA Rules not processed for user `d5383a86a7b34c1dad0e14b3d1971ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:05:56.383630 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-bfa345be-4e49-438e-82ec-58ce2ae7b574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:56.424520 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:56.454709 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1439/2855] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:05:56.466714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c66546-a325-4b56-9064-dfa4d78470d2 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:05:56.468507 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-00c66546-a325-4b56-9064-dfa4d78470d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:05:56.532030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c66546-a325-4b56-9064-dfa4d78470d2 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:05:56.535813 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86773e67-f8b4-4bf6-adc6-45a7055398cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:05:56.536500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86773e67-f8b4-4bf6-adc6-45a7055398cd service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:05:56.536882 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86773e67-f8b4-4bf6-adc6-45a7055398cd service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:05:56.537167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86773e67-f8b4-4bf6-adc6-45a7055398cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:05:56.546578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86773e67-f8b4-4bf6-adc6-45a7055398cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:05:56.548043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86773e67-f8b4-4bf6-adc6-45a7055398cd service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:05:56.558528 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1417/2856] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:05:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:06:06.451555 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=10 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:06.554377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:38.939896 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa345be-4e49-438e-82ec-58ce2ae7b574 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:39.002531 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa345be-4e49-438e-82ec-58ce2ae7b574 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:39.007568 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:39.008459 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:39.008743 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:39.009023 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] PATH_INFO: `/v3/users/d5383a86a7b34c1dad0e14b3d1971ba6` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:39.011021 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5383a86a7b34c1dad0e14b3d1971ba6)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:39.013038 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:39.069460 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5383a86a7b34c1dad0e14b3d1971ba6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.070118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5383a86a7b34c1dad0e14b3d1971ba6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.070754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5383a86a7b34c1dad0e14b3d1971ba6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.086093 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5383a86a7b34c1dad0e14b3d1971ba6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.099548 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5383a86a7b34c1dad0e14b3d1971ba6'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.114985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1440/2857] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:06:38 2022] DELETE /identity/v3/users/d5383a86a7b34c1dad0e14b3d1971ba6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:06:39.120049 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4d63-712d-4350-810b-535ead550981 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:39.120591 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4d63-712d-4350-810b-535ead550981 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:39.120734 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4d63-712d-4350-810b-535ead550981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:39.138772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-444c4d63-712d-4350-810b-535ead550981 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:39.140012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-444c4d63-712d-4350-810b-535ead550981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:39.204277 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1418/2858] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:39.216600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:39.218196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:39.289386 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a4fd8-9e9c-41d9-85ee-41f2b8af1286 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:39.294931 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fae1fe-56f6-477d-a21a-c30adb172e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:39.295585 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae1fe-56f6-477d-a21a-c30adb172e7e service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:39.295870 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae1fe-56f6-477d-a21a-c30adb172e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:39.296195 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae1fe-56f6-477d-a21a-c30adb172e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:39.308071 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae1fe-56f6-477d-a21a-c30adb172e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:39.309527 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae1fe-56f6-477d-a21a-c30adb172e7e service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:39.319271 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1441/2859] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:06:39.650848 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c4d63-712d-4350-810b-535ead550981 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:39.652305 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-444c4d63-712d-4350-810b-535ead550981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:39.664189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c4d63-712d-4350-810b-535ead550981 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:39.671280 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:39.672171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:39.672539 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:39.672785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] PATH_INFO: `/v3/projects/8b51a9b11a6e4069aa79b85ccb5408ac` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:39.674167 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b51a9b11a6e4069aa79b85ccb5408ac)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:39.680123 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:39.749731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b51a9b11a6e4069aa79b85ccb5408ac', 'request_id': 'req-87fde337-cbcd-48a0-8748-3d4664f598d7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.757258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b51a9b11a6e4069aa79b85ccb5408ac', 'request_id': 'req-87fde337-cbcd-48a0-8748-3d4664f598d7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.764000 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b51a9b11a6e4069aa79b85ccb5408ac', 'request_id': 'req-87fde337-cbcd-48a0-8748-3d4664f598d7'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.774506 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] The token cache is being invalidate because project 8b51a9b11a6e4069aa79b85ccb5408ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:06:39.774911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.775495 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-87fde337-cbcd-48a0-8748-3d4664f598d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:39.777063 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1419/2860] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:06:39 2022] DELETE /identity/v3/projects/8b51a9b11a6e4069aa79b85ccb5408ac => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:06:39.783425 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490de7c-245e-4f21-ab15-9f9fa7e33c3d None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:39.783714 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490de7c-245e-4f21-ab15-9f9fa7e33c3d None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:39.783991 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490de7c-245e-4f21-ab15-9f9fa7e33c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:39.802510 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-2490de7c-245e-4f21-ab15-9f9fa7e33c3d None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:39.803694 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-2490de7c-245e-4f21-ab15-9f9fa7e33c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:39.822863 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:39.873392 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1442/2861] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:39.882422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3122f-5046-476f-b59e-fd6cc7e3b7c0 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:39.882742 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3122f-5046-476f-b59e-fd6cc7e3b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:39.883023 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3122f-5046-476f-b59e-fd6cc7e3b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:39.901472 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-c1c3122f-5046-476f-b59e-fd6cc7e3b7c0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:39.902739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-c1c3122f-5046-476f-b59e-fd6cc7e3b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:39.911242 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1420/2862] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:39.921624 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490de7c-245e-4f21-ab15-9f9fa7e33c3d None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:39.932985 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490de7c-245e-4f21-ab15-9f9fa7e33c3d None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:39.938127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f2d23-5434-41ad-ab20-eb9c0229c257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:39.938832 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f2d23-5434-41ad-ab20-eb9c0229c257 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:39.939118 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f2d23-5434-41ad-ab20-eb9c0229c257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:39.939398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f2d23-5434-41ad-ab20-eb9c0229c257 admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:39.940128 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f2d23-5434-41ad-ab20-eb9c0229c257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:06:39.940734 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f2d23-5434-41ad-ab20-eb9c0229c257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:39.942084 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f2d23-5434-41ad-ab20-eb9c0229c257 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:39.955074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1443/2863] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:06:39.959722 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3122f-5046-476f-b59e-fd6cc7e3b7c0 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:39.970203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3122f-5046-476f-b59e-fd6cc7e3b7c0 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:39.975015 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068e891-6cd6-4482-9683-8dbf1b269bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:39.975672 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068e891-6cd6-4482-9683-8dbf1b269bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:39.975952 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068e891-6cd6-4482-9683-8dbf1b269bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:39.976233 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068e891-6cd6-4482-9683-8dbf1b269bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:39.976948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068e891-6cd6-4482-9683-8dbf1b269bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:39.979455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068e891-6cd6-4482-9683-8dbf1b269bf7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:40.006911 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1421/2864] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:06:39 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:06:40.011153 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f2d23-5434-41ad-ab20-eb9c0229c257 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:40.021591 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f2d23-5434-41ad-ab20-eb9c0229c257 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:40.080733 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41964b31-2d55-43e8-8f45-483a6f076296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:40.081401 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41964b31-2d55-43e8-8f45-483a6f076296 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:40.081950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41964b31-2d55-43e8-8f45-483a6f076296 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:40.082227 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41964b31-2d55-43e8-8f45-483a6f076296 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:40.082955 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41964b31-2d55-43e8-8f45-483a6f076296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:40.084868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41964b31-2d55-43e8-8f45-483a6f076296 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:40.107298 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1444/2865] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:06:40 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:06:40.112600 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068e891-6cd6-4482-9683-8dbf1b269bf7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:40.128171 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068e891-6cd6-4482-9683-8dbf1b269bf7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:40.134794 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27690f0-8265-4b53-9d4b-6487a200b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:40.135963 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27690f0-8265-4b53-9d4b-6487a200b518 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:40.136149 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27690f0-8265-4b53-9d4b-6487a200b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:40.136554 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27690f0-8265-4b53-9d4b-6487a200b518 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:40.137772 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27690f0-8265-4b53-9d4b-6487a200b518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:40.140220 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27690f0-8265-4b53-9d4b-6487a200b518 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:40.154381 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1422/2866] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:06:40.158769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41964b31-2d55-43e8-8f45-483a6f076296 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:40.170652 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41964b31-2d55-43e8-8f45-483a6f076296 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:40.175608 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93030b22-5192-4d7a-bd39-b0d9431c9c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:40.176286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030b22-5192-4d7a-bd39-b0d9431c9c6c admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:40.176576 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030b22-5192-4d7a-bd39-b0d9431c9c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:40.176859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030b22-5192-4d7a-bd39-b0d9431c9c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:40.177609 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93030b22-5192-4d7a-bd39-b0d9431c9c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:40.179253 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93030b22-5192-4d7a-bd39-b0d9431c9c6c admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:40.190126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1445/2867] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:06:40.195858 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27690f0-8265-4b53-9d4b-6487a200b518 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:40.206302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27690f0-8265-4b53-9d4b-6487a200b518 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:40.211379 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ced585-8177-411b-b08d-e393e3efbf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:40.212258 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ced585-8177-411b-b08d-e393e3efbf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:40.213237 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ced585-8177-411b-b08d-e393e3efbf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:40.213765 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ced585-8177-411b-b08d-e393e3efbf5b admin admin] PATH_INFO: `/v3/projects/49b36d0cffd34356a43b1ad6f8744453/users/ad7111143ed447d3b3889317f5bc311e/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:40.229691 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ced585-8177-411b-b08d-e393e3efbf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b36d0cffd34356a43b1ad6f8744453, user_id=ad7111143ed447d3b3889317f5bc311e, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:40.232389 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ced585-8177-411b-b08d-e393e3efbf5b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:40.245661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1423/2868] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:06:40 2022] PUT /identity/v3/projects/49b36d0cffd34356a43b1ad6f8744453/users/ad7111143ed447d3b3889317f5bc311e/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:06:40.256149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5d685-a764-4eb8-93b9-9353dafc486e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:40.256452 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5d685-a764-4eb8-93b9-9353dafc486e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:40.256720 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5d685-a764-4eb8-93b9-9353dafc486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:40.287504 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-d9b5d685-a764-4eb8-93b9-9353dafc486e None None] MFA Rules not processed for user `ad7111143ed447d3b3889317f5bc311e`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:40.288530 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-d9b5d685-a764-4eb8-93b9-9353dafc486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:40.358878 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1446/2869] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:06:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:40.372699 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ced585-8177-411b-b08d-e393e3efbf5b admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:40.374542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-57ced585-8177-411b-b08d-e393e3efbf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:40.398156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:40.437660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ced585-8177-411b-b08d-e393e3efbf5b admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:40.441454 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763c913-c229-4383-b5d2-19c4c9068633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0930d783a2574d5caeb2587fe4157cf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:40.442108 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c913-c229-4383-b5d2-19c4c9068633 service cinder] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:40.442412 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c913-c229-4383-b5d2-19c4c9068633 service cinder] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:40.442694 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763c913-c229-4383-b5d2-19c4c9068633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:40.451992 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763c913-c229-4383-b5d2-19c4c9068633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:40.453463 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763c913-c229-4383-b5d2-19c4c9068633 service cinder] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:40.463474 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1424/2870] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:06:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:06:50.355721 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:50.458607 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=17 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:02.029356 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5d685-a764-4eb8-93b9-9353dafc486e None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:02.103020 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5d685-a764-4eb8-93b9-9353dafc486e None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:02.107963 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:02.108831 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:02.109116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:02.109399 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] PATH_INFO: `/v3/users/ad7111143ed447d3b3889317f5bc311e` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:02.110644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7111143ed447d3b3889317f5bc311e)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:02.112567 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:02.163950 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7111143ed447d3b3889317f5bc311e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.164617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7111143ed447d3b3889317f5bc311e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.165772 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7111143ed447d3b3889317f5bc311e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.183286 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7111143ed447d3b3889317f5bc311e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.194677 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7111143ed447d3b3889317f5bc311e'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.214365 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1447/2871] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:07:02 2022] DELETE /identity/v3/users/ad7111143ed447d3b3889317f5bc311e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:07:02.219884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87c39b-4521-4c89-b69d-26bd03eb2ea0 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:02.220403 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87c39b-4521-4c89-b69d-26bd03eb2ea0 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:02.220766 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87c39b-4521-4c89-b69d-26bd03eb2ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:02.242092 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-bd87c39b-4521-4c89-b69d-26bd03eb2ea0 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:02.243355 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bd87c39b-4521-4c89-b69d-26bd03eb2ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:02.317202 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1425/2872] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:02.328821 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:02.330455 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:02.391631 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df20692-7bba-4a71-a88b-ec06ac3db048 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:02.395632 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdca35-b779-4100-bafe-8a6543be6b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:02.396389 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdca35-b779-4100-bafe-8a6543be6b78 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:02.396776 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdca35-b779-4100-bafe-8a6543be6b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:02.397159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdca35-b779-4100-bafe-8a6543be6b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:02.408657 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdca35-b779-4100-bafe-8a6543be6b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:02.410281 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdca35-b779-4100-bafe-8a6543be6b78 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:02.421176 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1448/2873] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:07:02.732439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87c39b-4521-4c89-b69d-26bd03eb2ea0 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:02.734706 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-bd87c39b-4521-4c89-b69d-26bd03eb2ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:02.754729 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87c39b-4521-4c89-b69d-26bd03eb2ea0 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:02.760064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:02.761378 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:02.761676 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:02.761998 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] PATH_INFO: `/v3/projects/49b36d0cffd34356a43b1ad6f8744453` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:02.763365 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b36d0cffd34356a43b1ad6f8744453)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:02.765563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:02.827960 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b36d0cffd34356a43b1ad6f8744453', 'request_id': 'req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.836142 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b36d0cffd34356a43b1ad6f8744453', 'request_id': 'req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.845159 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b36d0cffd34356a43b1ad6f8744453', 'request_id': 'req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.857251 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] The token cache is being invalidate because project 49b36d0cffd34356a43b1ad6f8744453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:07:02.857527 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.858207 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-46ccb6a2-eddd-4275-81f4-360bbfb5e69f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:07:02.859803 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1426/2874] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:07:02 2022] DELETE /identity/v3/projects/49b36d0cffd34356a43b1ad6f8744453 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:02.866219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7f0f5-05e1-4021-a13d-8a79013995de None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:02.866758 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7f0f5-05e1-4021-a13d-8a79013995de None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:02.867249 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7f0f5-05e1-4021-a13d-8a79013995de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:02.891409 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-29b7f0f5-05e1-4021-a13d-8a79013995de None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:02.892613 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-29b7f0f5-05e1-4021-a13d-8a79013995de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:02.916915 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:02.985196 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1449/2875] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:02.994680 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9443c-ee96-4ed2-8862-336ef0126394 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:02.995124 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9443c-ee96-4ed2-8862-336ef0126394 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:02.995603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9443c-ee96-4ed2-8862-336ef0126394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.020209 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-d7f9443c-ee96-4ed2-8862-336ef0126394 None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:03.021571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d7f9443c-ee96-4ed2-8862-336ef0126394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:03.029811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1427/2876] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:07:03.035446 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7f0f5-05e1-4021-a13d-8a79013995de None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:03.049291 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7f0f5-05e1-4021-a13d-8a79013995de None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:03.056701 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88b39-f05d-49c8-a45e-9c7f3509db0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:03.057787 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88b39-f05d-49c8-a45e-9c7f3509db0b admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.058202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88b39-f05d-49c8-a45e-9c7f3509db0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.058725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88b39-f05d-49c8-a45e-9c7f3509db0b admin admin] PATH_INFO: `/v3/domains` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.059902 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c88b39-f05d-49c8-a45e-9c7f3509db0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:07:03.060331 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c88b39-f05d-49c8-a45e-9c7f3509db0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:03.061850 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c88b39-f05d-49c8-a45e-9c7f3509db0b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:03.074684 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1450/2877] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jun 23 11:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:07:03.079562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9443c-ee96-4ed2-8862-336ef0126394 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:03.092758 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9443c-ee96-4ed2-8862-336ef0126394 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:03.097688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc7579-aacb-4ab8-aeec-bfb4f784daf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:03.098371 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc7579-aacb-4ab8-aeec-bfb4f784daf4 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.098661 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc7579-aacb-4ab8-aeec-bfb4f784daf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.098942 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc7579-aacb-4ab8-aeec-bfb4f784daf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.099631 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc7579-aacb-4ab8-aeec-bfb4f784daf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:03.101542 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc7579-aacb-4ab8-aeec-bfb4f784daf4 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:03.129924 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1428/2878] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:07:03 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:03.132247 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88b39-f05d-49c8-a45e-9c7f3509db0b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:03.143611 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88b39-f05d-49c8-a45e-9c7f3509db0b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:03.210337 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f7d94-a931-4e09-b8c7-9d5afd834d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:03.210926 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f7d94-a931-4e09-b8c7-9d5afd834d9b admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.211208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f7d94-a931-4e09-b8c7-9d5afd834d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.211488 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f7d94-a931-4e09-b8c7-9d5afd834d9b admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.212250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f7d94-a931-4e09-b8c7-9d5afd834d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:03.214208 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f7d94-a931-4e09-b8c7-9d5afd834d9b admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:03.242190 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1451/2879] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:07:03 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:03.247709 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc7579-aacb-4ab8-aeec-bfb4f784daf4 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:03.258490 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc7579-aacb-4ab8-aeec-bfb4f784daf4 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:03.266726 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57991f-37fe-49a4-9983-c6aed26aad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:03.267593 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57991f-37fe-49a4-9983-c6aed26aad00 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.267878 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57991f-37fe-49a4-9983-c6aed26aad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.268257 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57991f-37fe-49a4-9983-c6aed26aad00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.268997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57991f-37fe-49a4-9983-c6aed26aad00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:03.270926 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57991f-37fe-49a4-9983-c6aed26aad00 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:03.287344 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1429/2880] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:07:03.292554 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f7d94-a931-4e09-b8c7-9d5afd834d9b admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:03.303368 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f7d94-a931-4e09-b8c7-9d5afd834d9b admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:03.309817 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f45b9-31b7-479a-bad1-629fb6d8f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:03.310643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f45b9-31b7-479a-bad1-629fb6d8f4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.310970 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f45b9-31b7-479a-bad1-629fb6d8f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.311293 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f45b9-31b7-479a-bad1-629fb6d8f4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.312074 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f45b9-31b7-479a-bad1-629fb6d8f4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:03.313725 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f45b9-31b7-479a-bad1-629fb6d8f4c9 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:03.325740 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1452/2881] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:07:03.330311 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57991f-37fe-49a4-9983-c6aed26aad00 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:03.341637 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57991f-37fe-49a4-9983-c6aed26aad00 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:03.346262 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17ecec-537d-47e3-8a08-a667a3b415c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:03.347168 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17ecec-537d-47e3-8a08-a667a3b415c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.347458 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17ecec-537d-47e3-8a08-a667a3b415c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.347767 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17ecec-537d-47e3-8a08-a667a3b415c0 admin admin] PATH_INFO: `/v3/projects/8744aa675d3a4bbb8bb2b16a03b9aa61/users/b9ad67888a27457b87118583fc6b9a82/roles/6942da52ad6b472c8c12f7e2f9e7fd9b` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.370014 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17ecec-537d-47e3-8a08-a667a3b415c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8744aa675d3a4bbb8bb2b16a03b9aa61, user_id=b9ad67888a27457b87118583fc6b9a82, role_id=6942da52ad6b472c8c12f7e2f9e7fd9b)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:03.372716 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17ecec-537d-47e3-8a08-a667a3b415c0 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:03.387464 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1430/2882] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:07:03 2022] PUT /identity/v3/projects/8744aa675d3a4bbb8bb2b16a03b9aa61/users/b9ad67888a27457b87118583fc6b9a82/roles/6942da52ad6b472c8c12f7e2f9e7fd9b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:03.395358 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d224-a0f8-4adc-9be9-b483ad853c9e None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.395865 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d224-a0f8-4adc-9be9-b483ad853c9e None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.396361 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1d224-a0f8-4adc-9be9-b483ad853c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.418384 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-74c1d224-a0f8-4adc-9be9-b483ad853c9e None None] MFA Rules not processed for user `a27ae7f7dcd846e6909f95c2447d5f53`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:03.419617 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-74c1d224-a0f8-4adc-9be9-b483ad853c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:03.504406 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1453/2883] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:03.516948 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17ecec-537d-47e3-8a08-a667a3b415c0 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:03.518884 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-fb17ecec-537d-47e3-8a08-a667a3b415c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:03.546714 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:03.604981 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17ecec-537d-47e3-8a08-a667a3b415c0 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:03.611115 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf5093-b2b2-4862-a5c0-07833e5eda61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:03.612185 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf5093-b2b2-4862-a5c0-07833e5eda61 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:03.612675 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf5093-b2b2-4862-a5c0-07833e5eda61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:03.613157 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf5093-b2b2-4862-a5c0-07833e5eda61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:03.629518 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf5093-b2b2-4862-a5c0-07833e5eda61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:03.632244 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf5093-b2b2-4862-a5c0-07833e5eda61 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:03.651610 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1431/2884] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:07:08.711819 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cfc83-9cce-41f6-8f9b-46040c85bc69 None None] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:08.712690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cfc83-9cce-41f6-8f9b-46040c85bc69 None None] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:08.712690 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8cfc83-9cce-41f6-8f9b-46040c85bc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:08.754177 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.auth.core [None req-9f8cfc83-9cce-41f6-8f9b-46040c85bc69 None None] MFA Rules not processed for user `b9ad67888a27457b87118583fc6b9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=91930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:08.755577 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-9f8cfc83-9cce-41f6-8f9b-46040c85bc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:08.787398 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:08.856372 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1454/2885] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:07:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:08.861422 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf5093-b2b2-4862-a5c0-07833e5eda61 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:08.876022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf5093-b2b2-4862-a5c0-07833e5eda61 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:08.881154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0a8c-9d2d-4611-8ec7-b6263eaec6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:08.881747 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0a8c-9d2d-4611-8ec7-b6263eaec6e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:08.882030 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0a8c-9d2d-4611-8ec7-b6263eaec6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:08.882307 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b0a8c-9d2d-4611-8ec7-b6263eaec6e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:08.883043 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b0a8c-9d2d-4611-8ec7-b6263eaec6e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:08.885274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b0a8c-9d2d-4611-8ec7-b6263eaec6e7 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:08.914974 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1432/2886] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jun 23 11:07:08 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:08.920277 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cfc83-9cce-41f6-8f9b-46040c85bc69 None None] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:08.941179 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8cfc83-9cce-41f6-8f9b-46040c85bc69 None None] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:09.014219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45db4be-c81f-4643-9b88-f2186e365140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:09.014930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db4be-c81f-4643-9b88-f2186e365140 admin admin] REQUEST_METHOD: `POST` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:09.015223 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db4be-c81f-4643-9b88-f2186e365140 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:09.015501 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db4be-c81f-4643-9b88-f2186e365140 admin admin] PATH_INFO: `/v3/users` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:09.016201 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45db4be-c81f-4643-9b88-f2186e365140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:09.018126 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45db4be-c81f-4643-9b88-f2186e365140 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:09.039380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1455/2887] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jun 23 11:07:08 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:07:09.045985 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0a8c-9d2d-4611-8ec7-b6263eaec6e7 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:09.064050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b0a8c-9d2d-4611-8ec7-b6263eaec6e7 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:09.072636 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637e2d6-b752-4a75-837c-5ba4abaf3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:09.073785 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e2d6-b752-4a75-837c-5ba4abaf3882 admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:09.074274 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e2d6-b752-4a75-837c-5ba4abaf3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:09.074802 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e2d6-b752-4a75-837c-5ba4abaf3882 admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:09.076154 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637e2d6-b752-4a75-837c-5ba4abaf3882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:09.079397 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637e2d6-b752-4a75-837c-5ba4abaf3882 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:09.100868 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1433/2888] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:07:09.105418 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45db4be-c81f-4643-9b88-f2186e365140 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:09.115767 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45db4be-c81f-4643-9b88-f2186e365140 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:09.120937 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3ba04-1ca6-4095-90ec-1d2962052fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:09.121825 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3ba04-1ca6-4095-90ec-1d2962052fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:09.122204 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3ba04-1ca6-4095-90ec-1d2962052fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:09.122615 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3ba04-1ca6-4095-90ec-1d2962052fe4 admin admin] PATH_INFO: `/v3/projects/cf72aca9bda44c97a583b89d62052ca1/users/fb902757e6a44d4daac689e62ccf86d5/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:09.141132 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3ba04-1ca6-4095-90ec-1d2962052fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf72aca9bda44c97a583b89d62052ca1, user_id=fb902757e6a44d4daac689e62ccf86d5, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:09.145505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3ba04-1ca6-4095-90ec-1d2962052fe4 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:09.162050 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1456/2889] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:07:09 2022] PUT /identity/v3/projects/cf72aca9bda44c97a583b89d62052ca1/users/fb902757e6a44d4daac689e62ccf86d5/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:09.167046 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637e2d6-b752-4a75-837c-5ba4abaf3882 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:09.177731 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637e2d6-b752-4a75-837c-5ba4abaf3882 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:09.251236 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3bb73-1287-4dd5-990c-55fef363805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:09.251909 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3bb73-1287-4dd5-990c-55fef363805b admin admin] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:09.252189 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3bb73-1287-4dd5-990c-55fef363805b admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:09.252467 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3bb73-1287-4dd5-990c-55fef363805b admin admin] PATH_INFO: `/v3/roles` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:09.253195 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3bb73-1287-4dd5-990c-55fef363805b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:09.254989 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3bb73-1287-4dd5-990c-55fef363805b admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:09.271282 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1434/2890] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jun 23 11:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:07:09.275918 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3ba04-1ca6-4095-90ec-1d2962052fe4 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:09.287219 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3ba04-1ca6-4095-90ec-1d2962052fe4 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:09.293024 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38257fe-c7d4-4c83-8a6a-6ced1348b8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:09.293913 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38257fe-c7d4-4c83-8a6a-6ced1348b8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:09.294200 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38257fe-c7d4-4c83-8a6a-6ced1348b8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:09.294516 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38257fe-c7d4-4c83-8a6a-6ced1348b8ae admin admin] PATH_INFO: `/v3/projects/cf72aca9bda44c97a583b89d62052ca1/users/fb902757e6a44d4daac689e62ccf86d5/roles/2ca403234d1f4c32ba32cda2ff64228f` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:09.296574 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38257fe-c7d4-4c83-8a6a-6ced1348b8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf72aca9bda44c97a583b89d62052ca1, user_id=fb902757e6a44d4daac689e62ccf86d5, role_id=2ca403234d1f4c32ba32cda2ff64228f)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:09.299380 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38257fe-c7d4-4c83-8a6a-6ced1348b8ae admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:09.311388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1457/2891] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jun 23 11:07:09 2022] PUT /identity/v3/projects/cf72aca9bda44c97a583b89d62052ca1/users/fb902757e6a44d4daac689e62ccf86d5/roles/2ca403234d1f4c32ba32cda2ff64228f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:07:14.722982 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70f63-74fa-4b26-9aef-534e2a956280 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:14.724395 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70f63-74fa-4b26-9aef-534e2a956280 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:14.725247 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70f63-74fa-4b26-9aef-534e2a956280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:14.786745 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-46e70f63-74fa-4b26-9aef-534e2a956280 None None] MFA Rules not processed for user `fb902757e6a44d4daac689e62ccf86d5`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:14.788486 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-46e70f63-74fa-4b26-9aef-534e2a956280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:14.890415 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1435/2892] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:07:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:14.910804 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38257fe-c7d4-4c83-8a6a-6ced1348b8ae admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:14.912642 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f38257fe-c7d4-4c83-8a6a-6ced1348b8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:15.008411 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38257fe-c7d4-4c83-8a6a-6ced1348b8ae admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:15.017671 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64237d7-cfce-4ede-814a-d0a112311f8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:15.018475 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64237d7-cfce-4ede-814a-d0a112311f8a service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:15.018908 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64237d7-cfce-4ede-814a-d0a112311f8a service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:15.019193 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64237d7-cfce-4ede-814a-d0a112311f8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:15.025491 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:15.101794 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64237d7-cfce-4ede-814a-d0a112311f8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:15.104250 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64237d7-cfce-4ede-814a-d0a112311f8a service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:15.115481 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1458/2893] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:16.409022 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180c6a7-ea3d-4b13-91e2-dafdad2af788 None None] REQUEST_METHOD: `POST` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:16.411559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180c6a7-ea3d-4b13-91e2-dafdad2af788 None None] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:16.411559 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180c6a7-ea3d-4b13-91e2-dafdad2af788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:16.441480 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.auth.core [None req-2180c6a7-ea3d-4b13-91e2-dafdad2af788 None None] MFA Rules not processed for user `b9ad67888a27457b87118583fc6b9a82`. Rule list: `[]` (Enabled: `True`). {{(pid=91931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:07:16.442755 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2180c6a7-ea3d-4b13-91e2-dafdad2af788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:16.452353 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1436/2894] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jun 23 11:07:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:07:25.111033 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=24 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:26.435580 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:44.367505 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64237d7-cfce-4ede-814a-d0a112311f8a service nova] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:44.369139 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-a64237d7-cfce-4ede-814a-d0a112311f8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:44.445713 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64237d7-cfce-4ede-814a-d0a112311f8a service nova] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:44.456014 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257751f6-cf37-4fe5-9f66-4ba400ab1a0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:44.457529 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257751f6-cf37-4fe5-9f66-4ba400ab1a0b service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:44.457813 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257751f6-cf37-4fe5-9f66-4ba400ab1a0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:44.458094 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257751f6-cf37-4fe5-9f66-4ba400ab1a0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:44.460068 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-257751f6-cf37-4fe5-9f66-4ba400ab1a0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:44.471144 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257751f6-cf37-4fe5-9f66-4ba400ab1a0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:44.472588 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257751f6-cf37-4fe5-9f66-4ba400ab1a0b service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:44.482194 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1459/2895] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:45.200713 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180c6a7-ea3d-4b13-91e2-dafdad2af788 None None] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:45.204504 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-2180c6a7-ea3d-4b13-91e2-dafdad2af788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:45.233571 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180c6a7-ea3d-4b13-91e2-dafdad2af788 None None] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:45.255861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa168-b6ae-4e04-8d1e-f502029fa644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:45.257529 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa168-b6ae-4e04-8d1e-f502029fa644 service nova] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:45.258055 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa168-b6ae-4e04-8d1e-f502029fa644 service nova] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:45.258651 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa168-b6ae-4e04-8d1e-f502029fa644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:45.261934 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-d19aa168-b6ae-4e04-8d1e-f502029fa644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:45.287386 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19aa168-b6ae-4e04-8d1e-f502029fa644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:45.291051 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19aa168-b6ae-4e04-8d1e-f502029fa644 service nova] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:45.313439 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1437/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:54.477506 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=26 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:55.304917 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:07:55.760888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257751f6-cf37-4fe5-9f66-4ba400ab1a0b service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:55.780868 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257751f6-cf37-4fe5-9f66-4ba400ab1a0b service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:55.786928 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879ded-2b51-4c7d-865b-ab3477a58ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:55.787589 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879ded-2b51-4c7d-865b-ab3477a58ef8 service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:55.787876 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879ded-2b51-4c7d-865b-ab3477a58ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:55.788159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879ded-2b51-4c7d-865b-ab3477a58ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:55.790890 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-fb879ded-2b51-4c7d-865b-ab3477a58ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:07:55.805859 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb879ded-2b51-4c7d-865b-ab3477a58ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:55.809107 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb879ded-2b51-4c7d-865b-ab3477a58ef8 service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:55.821961 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1460/2897] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:07:58.441126 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa168-b6ae-4e04-8d1e-f502029fa644 service nova] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:07:58.450915 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa168-b6ae-4e04-8d1e-f502029fa644 service nova] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:07:58.454574 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3625434-adf9-4e85-abb8-914a62439466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:07:58.455219 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3625434-adf9-4e85-abb8-914a62439466 service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:07:58.455498 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3625434-adf9-4e85-abb8-914a62439466 service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:07:58.455778 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3625434-adf9-4e85-abb8-914a62439466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:07:58.466264 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3625434-adf9-4e85-abb8-914a62439466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:07:58.467717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3625434-adf9-4e85-abb8-914a62439466 service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:07:58.479016 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1438/2898] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:07:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:00.156781 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879ded-2b51-4c7d-865b-ab3477a58ef8 service nova] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:00.175703 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879ded-2b51-4c7d-865b-ab3477a58ef8 service nova] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:00.185300 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49e915-137c-4d24-bc0b-2f1933a671da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d639e845cfa4f10b8e86cd237664c9b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:00.186480 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49e915-137c-4d24-bc0b-2f1933a671da service nova] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:00.186997 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49e915-137c-4d24-bc0b-2f1933a671da service nova] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:00.187519 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49e915-137c-4d24-bc0b-2f1933a671da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:00.190507 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-fa49e915-137c-4d24-bc0b-2f1933a671da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:00.214397 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49e915-137c-4d24-bc0b-2f1933a671da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:00.216019 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49e915-137c-4d24-bc0b-2f1933a671da service nova] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:00.228930 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1461/2899] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:08.473920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:10.222988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=12 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:18.348314 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3625434-adf9-4e85-abb8-914a62439466 service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:18.349749 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f3625434-adf9-4e85-abb8-914a62439466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:18.423470 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3625434-adf9-4e85-abb8-914a62439466 service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:18.428455 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b78a-4e17-4629-9ce5-16338f5ef33d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:18.429131 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b78a-4e17-4629-9ce5-16338f5ef33d service placement] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:18.429411 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b78a-4e17-4629-9ce5-16338f5ef33d service placement] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:18.429685 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b78a-4e17-4629-9ce5-16338f5ef33d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:18.432012 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-8741b78a-4e17-4629-9ce5-16338f5ef33d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:18.444203 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741b78a-4e17-4629-9ce5-16338f5ef33d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:18.445801 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741b78a-4e17-4629-9ce5-16338f5ef33d service placement] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:18.457325 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1439/2900] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:28.452700 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=32 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.424994 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49e915-137c-4d24-bc0b-2f1933a671da service nova] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.437753 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49e915-137c-4d24-bc0b-2f1933a671da service nova] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.441502 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e8211-56ea-4dea-8fa4-dd0d0b5364ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.442396 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e8211-56ea-4dea-8fa4-dd0d0b5364ba service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.442649 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e8211-56ea-4dea-8fa4-dd0d0b5364ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.442962 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e8211-56ea-4dea-8fa4-dd0d0b5364ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.448357 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-664e8211-56ea-4dea-8fa4-dd0d0b5364ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:14.465254 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e8211-56ea-4dea-8fa4-dd0d0b5364ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.468762 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e8211-56ea-4dea-8fa4-dd0d0b5364ba service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.483923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1462/2901] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:15.696173 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b78a-4e17-4629-9ce5-16338f5ef33d service placement] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.706300 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b78a-4e17-4629-9ce5-16338f5ef33d service placement] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.711321 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9968e12-9825-4ce5-92a0-116ac8e209ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.713565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9968e12-9825-4ce5-92a0-116ac8e209ce service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.713565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9968e12-9825-4ce5-92a0-116ac8e209ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.713565 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9968e12-9825-4ce5-92a0-116ac8e209ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.714853 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-f9968e12-9825-4ce5-92a0-116ac8e209ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:15.730499 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9968e12-9825-4ce5-92a0-116ac8e209ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.731956 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9968e12-9825-4ce5-92a0-116ac8e209ce service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.748254 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1440/2902] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:10:24.478344 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=6 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:25.740862 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=6 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:27.820643 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e8211-56ea-4dea-8fa4-dd0d0b5364ba service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:27.829742 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e8211-56ea-4dea-8fa4-dd0d0b5364ba service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:27.833790 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed7db-9b41-4c3e-bdf0-0f6460e5af3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:27.834745 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed7db-9b41-4c3e-bdf0-0f6460e5af3a service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:27.835031 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed7db-9b41-4c3e-bdf0-0f6460e5af3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:27.835312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afed7db-9b41-4c3e-bdf0-0f6460e5af3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:27.837182 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-6afed7db-9b41-4c3e-bdf0-0f6460e5af3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:27.847728 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afed7db-9b41-4c3e-bdf0-0f6460e5af3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:27.849202 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afed7db-9b41-4c3e-bdf0-0f6460e5af3a service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:27.858312 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1463/2903] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:27.986050 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9968e12-9825-4ce5-92a0-116ac8e209ce service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:27.999156 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9968e12-9825-4ce5-92a0-116ac8e209ce service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:28.005447 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff499-cf3f-4f99-abb4-48fcc467217a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:28.007070 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff499-cf3f-4f99-abb4-48fcc467217a service neutron] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:28.007509 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff499-cf3f-4f99-abb4-48fcc467217a service neutron] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:28.007781 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aff499-cf3f-4f99-abb4-48fcc467217a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.009721 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-e1aff499-cf3f-4f99-abb4-48fcc467217a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:28.021451 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aff499-cf3f-4f99-abb4-48fcc467217a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:28.023064 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aff499-cf3f-4f99-abb4-48fcc467217a service neutron] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:28.033021 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1441/2904] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:28.141618 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed7db-9b41-4c3e-bdf0-0f6460e5af3a service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:28.152159 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afed7db-9b41-4c3e-bdf0-0f6460e5af3a service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:28.156240 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a85eea-473d-4782-83b1-a8d1709f04f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:28.156898 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a85eea-473d-4782-83b1-a8d1709f04f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:28.157184 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a85eea-473d-4782-83b1-a8d1709f04f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:28.157462 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a85eea-473d-4782-83b1-a8d1709f04f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.159369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-f3a85eea-473d-4782-83b1-a8d1709f04f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:28.175390 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a85eea-473d-4782-83b1-a8d1709f04f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:28.178172 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a85eea-473d-4782-83b1-a8d1709f04f3 service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:28.190301 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1464/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:28.258223 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff499-cf3f-4f99-abb4-48fcc467217a service neutron] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:28.279555 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aff499-cf3f-4f99-abb4-48fcc467217a service neutron] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:28.287962 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa059-c13a-4b3c-a523-7866908bd20e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:28.289059 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa059-c13a-4b3c-a523-7866908bd20e service placement] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:28.289546 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa059-c13a-4b3c-a523-7866908bd20e service placement] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:28.290034 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aaa059-c13a-4b3c-a523-7866908bd20e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.292208 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-b7aaa059-c13a-4b3c-a523-7866908bd20e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:28.305204 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaa059-c13a-4b3c-a523-7866908bd20e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:28.306856 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aaa059-c13a-4b3c-a523-7866908bd20e service placement] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:28.318584 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1442/2906] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:38.184923 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=12 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:38.313068 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=12 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:12.965376 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a85eea-473d-4782-83b1-a8d1709f04f3 service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:12.975456 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a85eea-473d-4782-83b1-a8d1709f04f3 service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:12.979754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ea98-e62e-4267-8ab2-d24aa1d16d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed8f21a950d6483abc7ab67fb533942a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:12.980402 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ea98-e62e-4267-8ab2-d24aa1d16d5c service neutron] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:12.980693 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ea98-e62e-4267-8ab2-d24aa1d16d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:12.980979 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019ea98-e62e-4267-8ab2-d24aa1d16d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:13.045664 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019ea98-e62e-4267-8ab2-d24aa1d16d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:13.047127 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019ea98-e62e-4267-8ab2-d24aa1d16d5c service neutron] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:13.057750 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1465/2907] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:12:16.268739 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa059-c13a-4b3c-a523-7866908bd20e service placement] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:16.279861 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aaa059-c13a-4b3c-a523-7866908bd20e service placement] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:16.285077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5e699-a936-4578-a8b0-d36cace3caab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:16.285717 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5e699-a936-4578-a8b0-d36cace3caab service placement] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:16.285997 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5e699-a936-4578-a8b0-d36cace3caab service placement] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:16.286271 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5e699-a936-4578-a8b0-d36cace3caab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:16.288710 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ace5e699-a936-4578-a8b0-d36cace3caab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:16.301352 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5e699-a936-4578-a8b0-d36cace3caab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:16.303193 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5e699-a936-4578-a8b0-d36cace3caab service placement] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:16.323898 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1443/2908] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:12:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:12:19.241769 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ea98-e62e-4267-8ab2-d24aa1d16d5c service neutron] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:19.258877 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019ea98-e62e-4267-8ab2-d24aa1d16d5c service neutron] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:19.270256 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab47173-48a5-42cd-9322-b15b005011f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:19.271116 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab47173-48a5-42cd-9322-b15b005011f7 service placement] REQUEST_METHOD: `GET` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:19.271754 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab47173-48a5-42cd-9322-b15b005011f7 service placement] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:19.272046 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab47173-48a5-42cd-9322-b15b005011f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:19.274079 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-8ab47173-48a5-42cd-9322-b15b005011f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:19.288583 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab47173-48a5-42cd-9322-b15b005011f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:19.290939 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab47173-48a5-42cd-9322-b15b005011f7 service placement] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:19.305600 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1466/2909] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:12:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:12:19.343534 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5e699-a936-4578-a8b0-d36cace3caab service placement] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:19.356991 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5e699-a936-4578-a8b0-d36cace3caab service placement] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:19.362688 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:19.363563 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:19.363839 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:19.364114 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] PATH_INFO: `/v3/users/b9ad67888a27457b87118583fc6b9a82` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:19.365562 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ad67888a27457b87118583fc6b9a82)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:19.367522 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:19.419946 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ad67888a27457b87118583fc6b9a82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.420695 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ad67888a27457b87118583fc6b9a82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.434578 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ad67888a27457b87118583fc6b9a82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.445660 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ad67888a27457b87118583fc6b9a82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.454377 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ad67888a27457b87118583fc6b9a82'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.461811 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1444/2910] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:12:19 2022] DELETE /identity/v3/users/b9ad67888a27457b87118583fc6b9a82 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:19.655279 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab47173-48a5-42cd-9322-b15b005011f7 service placement] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:19.671977 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab47173-48a5-42cd-9322-b15b005011f7 service placement] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:19.739066 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:19.740564 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:19.740862 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:19.741149 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] PATH_INFO: `/v3/projects/8744aa675d3a4bbb8bb2b16a03b9aa61` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:19.742500 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8744aa675d3a4bbb8bb2b16a03b9aa61)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:19.744448 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:19.799888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'request_id': 'req-61c01967-665f-4c82-ab06-beafb81e08e1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.808133 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'request_id': 'req-61c01967-665f-4c82-ab06-beafb81e08e1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.816131 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8744aa675d3a4bbb8bb2b16a03b9aa61', 'request_id': 'req-61c01967-665f-4c82-ab06-beafb81e08e1'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.828096 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] The token cache is being invalidate because project 8744aa675d3a4bbb8bb2b16a03b9aa61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:12:19.828388 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.829085 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.830836 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1467/2911] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:12:19 2022] DELETE /identity/v3/projects/8744aa675d3a4bbb8bb2b16a03b9aa61 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:19.836125 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:19.837598 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:19.851723 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874486-bd5c-40cf-b193-e8e1c37a5315 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:19.917246 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:19.918100 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:19.918415 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:19.918707 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] PATH_INFO: `/v3/users/fb902757e6a44d4daac689e62ccf86d5` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:19.920077 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb902757e6a44d4daac689e62ccf86d5)` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:19.922019 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:19.980407 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb902757e6a44d4daac689e62ccf86d5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.981147 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb902757e6a44d4daac689e62ccf86d5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:19.994920 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:19.999965 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb902757e6a44d4daac689e62ccf86d5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:20.010927 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb902757e6a44d4daac689e62ccf86d5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:20.020166 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.notifications [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb902757e6a44d4daac689e62ccf86d5'} {{(pid=91931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:20.030558 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1445/2912] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jun 23 11:12:19 2022] DELETE /identity/v3/users/fb902757e6a44d4daac689e62ccf86d5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:20.245565 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] Authenticating user token {{(pid=91930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:20.247464 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.fernet_utils [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:20.261590 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c01967-665f-4c82-ab06-beafb81e08e1 admin admin] Validating token access rules against request {{(pid=91930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:20.272989 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:20.333888 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a27ae7f7dcd846e6909f95c2447d5f53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '90bfbe3ca19640a8a67be01b638e500f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:20.334812 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:20.335369 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:20.335637 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] PATH_INFO: `/v3/projects/cf72aca9bda44c97a583b89d62052ca1` {{(pid=91930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:20.336988 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf72aca9bda44c97a583b89d62052ca1)` {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:20.339018 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] RBAC: Authorization granted {{(pid=91930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:20.400551 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf72aca9bda44c97a583b89d62052ca1', 'request_id': 'req-0901505c-61c3-4bee-a2e8-816dc781da67'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:20.408943 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf72aca9bda44c97a583b89d62052ca1', 'request_id': 'req-0901505c-61c3-4bee-a2e8-816dc781da67'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:20.417629 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf72aca9bda44c97a583b89d62052ca1', 'request_id': 'req-0901505c-61c3-4bee-a2e8-816dc781da67'} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:20.433687 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] The token cache is being invalidate because project cf72aca9bda44c97a583b89d62052ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:12:20.433981 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:20.434644 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG keystone.notifications [None req-0901505c-61c3-4bee-a2e8-816dc781da67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:20.436210 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: [pid: 91930|app: 0|req: 1468/2913] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jun 23 11:12:20 2022] DELETE /identity/v3/projects/cf72aca9bda44c97a583b89d62052ca1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:30.023603 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:30.430486 dv-cinder-846146-4-iscsi devstack@keystone.service[91930]: DEBUG dbcounter [-] [91930] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:22.322966 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] Authenticating user token {{(pid=91931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:22.324684 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:22.482401 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1052379-face-4faf-b987-81ace6758bc0 admin admin] Validating token access rules against request {{(pid=91931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:22.543841 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55ef7e-0050-4516-af27-d25230294cad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64ce422f60d64b368df8be61e1065282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bb8e755bc874373b86cddae63b92654', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:22.544500 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ef7e-0050-4516-af27-d25230294cad service placement] REQUEST_METHOD: `GET` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:22.544786 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ef7e-0050-4516-af27-d25230294cad service placement] SCRIPT_NAME: `/identity` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:22.545069 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ef7e-0050-4516-af27-d25230294cad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:22.546887 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.fernet_utils [None req-9b55ef7e-0050-4516-af27-d25230294cad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:22.559567 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55ef7e-0050-4516-af27-d25230294cad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:22.561179 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55ef7e-0050-4516-af27-d25230294cad service placement] RBAC: Authorization granted {{(pid=91931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:22.572103 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: [pid: 91931|app: 0|req: 1446/2914] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:32.567302 dv-cinder-846146-4-iscsi devstack@keystone.service[91931]: DEBUG dbcounter [-] [91931] Writing DB stats keystone:SELECT=89 {{(pid=91931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}